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ABSTRACT 


Forty  experimental  dlyads  were  composed  for  study  designed  to  test 
a  transactional  theory  which  views  interpersonal  behavior  as  being 
comnunicated  simultaneously  on  three  channels.    Tha  dyads  ranged  from 
compatibility  to  incompatibility  through  all  possible  combinations  on 
the  three  channels.   The  dyads  were  identified  from  a  battery  of  instru 
ments  administered  to  200  subjects.   The  general  hypv  hesis  was  that 
there  would  be  a  linear  relationship  between  intra-group  compatibility 
and  a  set  of  five  dependent  variables.    Each  of  the  40  dyads  were 
scheduled  for  a  half-hour  discussion  period  in  which  the  members 
worked  together  to  solve  a  case  study  problem.    Following  the  dis- 
cussion session  each  member  was  given  a  set  of  post  meeting  instru- 
ments to  complete.    Results  on  three  of  the  linear  relationships  were 
in  the  predicted  direction. 
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Background  and  Theory 

There  is  sufficient  empirical  evidence  to  conceptualize  the 
communication  networks  of  small  face-to-face  groups  as  being  composed 
of  three  simultaneously  operating  channels.    The  three  channels  have 
been  identified  as  the  motivation^  deJUve/iy  and  ^({o/unotton  channels. 
Basic  concerns  are  expressed  through  the  motivation  channel.    The  manner 
in  which  an  utterance  is  delivered  in  a  group  is  here  referred  to  as  the 
deJUvefty  channel.    The  cognitive  system  of  an  individual  in  a  group  setting 
is  here  identified  as  the  Iniofumtlon  channel.    The  problem  which  was 
Investigated  may  be  more  readily  understood  through  a  discussion  of 
previous  research  which  served  to  more  clearly  delineate  the  scope  of 
the  study. 

There  are  many  variables  and  combinations  of  variables  which 
have  been  identified  and  investigated  in  the  stud^  of  small  groups.  Some 
researchers  have  focused  their  attention  on  the  input  variables.  These 
studies  are  concerned  generally  with  personality,  basic  needs*  or  psycho- 
dynamics  of  group  members.   Many  of  these  studies  have  been  5i)le  to 
demonstrate  that  such  variables  may  be  accountable  for  sizeable  proportions 
of  the  variance  of  group  behavior  (Hare,  1962).    Other  studies  have 
Investigated  the  inter- personal  communication  styles  of  group  members. 
These  studies  have  been  able  to  show  evidence  that  part  of  the  variance 
can  be  consistently  explained  by  the  pattern  of  the  conmuni cation  styles 
(Schein  and  Bennis,  1965).   There  are  studies  which  have  examined  the 
exchange  of  information  and  the  communication  channels  as  variables  in  the 
life  of  small  groups.   Such  studies  have  also  found  meaningful  and 


statistically  significant  results  (Bales,  et  al.,  1958).   Finally,  there 
is  a  growing  body  of  knowledge  about  relationships  between  outcomes  and 
the  transactions  of  groups  (Collins  and  Guetzkow,  1964). 

It  is  not  difficult  to  realize  that  a  paradigm  which  could 
encompass  the  three  phases,  input,  operation  and  outcome,  should  prove 
to  be  a  very  powerful  instrument  in  the  study  of  small  groups. 

The  first  question  that  may  be  raised  is:   Do  individuals  act 
during  the  interaction  session  of  a  group  in  the  manner  indicated  by  a  pre- 
meeting  measure?   Hare  (1962)  concluded  after  a  review  of  the  literature 
that,  "although  it  is  evident  that  the  variety  of  behavior  which  has  been 
predicted  from  paper-and-pencil  or  projective  tests  generally  support 
the  hypothesis  of  an  underlying  consistency  in  behavior,  the  evidence 
is  not  all  positive."^ 

The  conflicting  evidence  which  Hare  reports  on  the  consistency 
between  pre-meeting  and  interaction  measures  may  be  due  in  large  part  to 
the  use  of  one  system  of  personality  attributes  uoon  which  to  predict 
behavior  and  another  system  of  interaction  categories  to  test  the  con- 
sistency hypothesis.   This^ explanation  may  explain  why  Borgotta  and 
Eschenbach,  (1955)  found  no  significant  relation  between  Rorschach  scoror, 
and  behaviors  scored  by  Bales'  categories.    In  previous  research, 
Fouriezos,  Huth,  and  Guetzkow  (1950)  were  able  to  demonstrate  significance 
between  Rorschach  scores  and  such  behavior  categories  as  dependency, 
dominance,  aggression,  etc.   Thelen  and  associates  (1958)  studied  group- 
relevant  aspects  of  personality  and  found  a  high  correlation  between  a 
pre-session  measure  (R6ST  instrument)  and  behavior  during  group  meetings 
(observation  data).   Both  sets  of  data  were  based  on  the  same  category 
system. 


Although  the  statistical  results  were  supportive  of  the  consistency 
hypothesis  the  obvious  variance  continued  to  raise  questions.   Breer  (1960) 
found  that  preinteraction  measures  of  the  subject  and  the  other  person  with 
whom  the  subject  was  to  interact  vas  superior  to  a  measure  based  on 
attributes  of  the  subject  alone.    The  extensive  work  carried  out  by 
Schutz  (1955,  1958)  provided  much  support  to  this  further  refinement  of 
the  consistency  hypothesis.   The  consistency  hypothesis  was  upheld  by 
the  work  of  other  researchers  (Haythorne  et.  al.,  1956a,  1956b). 

The  significance  of  the  work  of  these  investigators  went  beyond 
their  contribution  to  the  consistency  hypothesis.    It  is  clearly  evident 
from  their  work  that  the  consistency  hypothesis  and  the  interaction 
hypothesis  (one  can  only  describe  a  group  as  it  interacts)  are  incorrectly 
viewed  as  conflictual.    In  the  study  and  description  of  small  groups 
they  are  complementary.  ~ 

Our  knowledge  cf  groups  has  long  since  led  us  to  know  that 
personality  is  only  one  major  component  of  a  study  of  small  groups. 
Fror  the  classic  experiment  of  Lewin,  Lippit  and  Whyte  (1960)  the 
students  of  small  groups  have  been  very  much  concerned  with  leadership 
styles  and  subsequently  interaction  styles  of  group  mambers  (Fox,  1957; 
Ziller,  1957;  Hare,  1953).    Ben-Zeev  (1955)  was  one  investigator  who  most 
clearly  differentiated  personality  and  interaction  style  are  dynamically 
related  but  do  not  come  in  predestined  counterparts. 

The  work  of  Stogdill  (1959),  Leavitt  (1951),  Guetzkow  (I960), 
among  others,  has  been  directed  towards  the  consideration  of  the  infor- 
mation exchange  among  members.   The  significance  of  such  research  findinggs 
have  found  direct  application  in  the  variety  of  settings  from  business  to 
family  counseling. 


In  very  brief  terms  the  above  maic^rial  identified  three  time 
phases:   input,  operation  and  outcome.   Three  components  concerned  in  all 
three  time  phases  are  identified  as  being  basic  components  in  the  life  of 
any  small  group.   These  are  personality  of  members,  interaction  styles 
members  employ y  and  the  information  members  bring  and  exchange. 

The  importance  of  any  one  of  these  components  cannot  be  questioned 
in  the  face  of  our  accumulated  knowledge.   The  stage  of  our  progress  should 
be  at  the  investigation  of  the  interrelationships  among  these  components. 
To  this  end  Boyd  (1964,  1966)  proposed  the  following  paradigm.  The 
investigators  employed  this  paradigm. 

The  study  was  conducted  within  a  defined  conceptual  framework. 
In  brief  terms  it  may  be  conceptual izaed  as  a  transactional  model.  A 
group  can  be  viewed  as  an  input,  operation,  and  output  system.   A  group 
at  the  same  time  can  be  viewed  as  having  three  channels  in  its  con^ 
cation  system.    Specifically,^  these  are  the  wtivations  (psychologic,  needs 
an  Individual  brings  to  a  group);  delivery  (the  manner  "In  which  individuals 
relate  to  others);  and  information  (the  knowledge  individuals  have  at 
their  disposal). 

Hypotheses 

It  was  reasoned  that  the  motivation  channel  would  have  the  greatest  . 
weight  in  small  group  transaction.    This  was  basec".  on  the  argument  that 
basic  concerns  (socio--psychological  tensions)  must  be  handled  first 
before  an  individual  can  clearly  perceive  and  deal  with  either  the 
delivery  or  the  information  channel.    It  was  further  argued  that  were 
the  motivation  channel  free  of  disturbance  the  delivery  channel  would 
be  next  In  importance.    Delivery  styles  disrupt  a  communication  system 


more  readily  then  does  information  even  if  the  information  were  also 
repulsive  to  the  listener.   Another  way  to  view  this  is  if  the  Information 
were  acceptable  to  the  listener  the  noise  of  a  perceived  negative  delivery 
style  would  seriously  disrupt'  the  ihfonnation  messaties  from  being  heard. 
Thus  our  argument  proposed  a  hierarchy  of  the  three  channels. 

To  operational ize  this  conjecture  it       proposed  that  a  procedure 
which  would  establish  degrees  of  compatibility  be  employed.  Accordingly, 
it  was  proposed  that  the  higher  the  compatibilUy  in  any  one  channel  a 
decreasing  amount  of  noise  would  be  observable  in  the  transactions.  For 
example,  were  tv.'o  memebers  of  a  group  highly  compatible  on  the  motivation 
channel  they  would  be  more  able  to  direct  their  attention  to  the  other 
two  channels.   Further,  if  they  were  also  compatible  on  the  delivery 
channel  they  could  then  direct  their  full  attention  to  the  information 
channel.    In  this  manner  it  would  be  argued  that  persons  compatible  on  the 
motivation  and  delivery  channels  woulf  transact  more  on  the  information 
channel  than  would  individuals  who  were  net  compatible  on  these  channels. 
This  statement  represents  in  gross  terms  the  conjecture  that  was  proposed 
and  tested. 

Since  a  large  number  of  variable  compose  the  transactions  of  a 
small  face-to-face  group  a  design  was  proposed  to  restrict  the  significance 
of  those  factors  which  tlid  not  directly  bear  on  the  problem  at  hand. 
Accordingly  an  experimental  design  was  developed  composing  dyad  groups 
having  various  degrees  of  compatibility  on  the  three  independent  variables, 
namely,  the  motivation,  delivery  and  information  channels.   Thus  it  was 
possible  to  compose  dyads  with  all  three  channels  highly  compatible 
progressively  to  dyads  where  all  three  channels  were  highly  incompatible. 


To  avoid  a  lengthy  description  of  the  coinposition  of  these 
groups  they  are  described  syjnbolically  in  quasi -mathematicil  formulations 
in  Table  1.   All  groups  are  dyads.   Let  x  stand  for  one  member  and  y  repre- 
sent the  second  member.   The  symbols  H,  D,  and  I  stand  for  the  motivation, 
delivery  and  information  channels  respectively.   The  notation  =  ireans 
that  there  exists  a  high  measure  of  compatibility  between  the  tnfo  membe»^, 
while  the  notation  ^  should  be  interpreted  to  mean  a  low  measure  of 
compatibility. 


TABLE  1  GOES  ABOUT  HERE 


The  two  variables  of  sex  and  age  were  controlled  in  the  compo- 
sition of  all  dyads.   Thus  a  group  was  either  two  males  or  two  females. 
All  groups  were  composed  of  members  who  did  not  differ  more  than  five 
years  in  age. 

The  hypotheses  were:^ 

1.  There  will  be  a  positive  linear  relatiowMp  between 
compatibility  and  congruency  on  the  ideal  member  :^nd 
actual  meinber  profiles. 

2.  a.    If  M,  D  and  I  channel  are  compatible  members  will 

describe  their  group  session  in  more  positive  work 
terms  than  all  other  dyad  types. 

2.b.  If  I  channel  Is  the  only  incompatible  channel  members 
will  describe  their  group  session  in  equally  weighted 
terms  on  all  three  channels. 

2.C.    If  M  and  !  channels  are  compatible  but  D  channel  is 
not  members  will  describe  their  group  session  more  in 
term  of  the  D  channel  than  all  other  4yad  types. 


Two  other  hypotheses  were  proposed  but  the  exploratory  nature  of 
the  methodology  raised  many  issues.   In  view  of  these  this  aspect  of  the 
experiment  was  omitted. 
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2.d.  If  0  and  I  channels  are  compatible  but  M  channel  Is  not 
mwnbers  will  describe  their  group  sessiog.  more  in  terms 
of  the  .1  channel  than  all  other  dyad  types. 

2.  e.   Group  a.jnibers  inconpatible  on  two  or  more  channels  will 

describe  their  group  session  more  in  terms  of  the  H 
channel  than  any  other  channel. 

3.  The  dyad  types  will  be  ordered  from  1  through  8  on  the 
analysis  of  the  information  test  such  that  the  groups  will 
be  differentiated  significantly  on: 

a.  statements  indicating  joint  development 
of  decisions 

b.  statements  m<^de  by  himself  during  the 
meetings 

c.  statements  made  by  other  member  during  the 
meetings 


Design 

The  design  of  this  project  is  divided  in  three  phases,  namely 
the  pre-experiment  phase,  the  experimental  phase  and  the  post  experiment 
phase. 


Pre-experiment  Phase;    Two  hundred  and  forty-eignt  undergraduate  univer- 
sity students  volunteered  to  complete  a  set  of  four  (4)  questionnaires. 
These  were  the  Self-description  and  Alter-description  questionnaires 
(M  channel)  and  the  Expressed  and  Interpersonal  Relations  questlonniares 
(0  channel).   The  results  of  these  questlonniares  enabled  the  investi- 
gators to  identify  the  various  levels  of  compatibility  among  individuals 
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in  this  base  population.'   Having  identifiwd  the  levels  of  compatibility 
for  each  pair  of  individuals,  forty  (40)  pairs  were  selected  to  partici- 
pate in  the  next  phase  of  the  experiment.   These  dyads  consisted  of  8 
differing  types  of  compatibility  on  the  three  channels  (M,  D  and  I),  with 
five  (5)  representative  dyads  of  each  type. 

Experimental  Phase;   Arrangements  were  made  for  each  of  the  dlyads  to  meet 
for  one  and  one-half  hours.    There  were  three  (3)  parts  in  this  session. 
In  the  first  part  there  were  two  tasks.    The  first  task  was  to  complete 
a  thirty-two  (32)  item  Semantic  Differential.   The  individuals  were  asked 
to  do  this  in  reference  to  the  person  they  would  most  like  to  work  with 
in  a  small  work  group.   The  second  task  was  to  listen  to  tape-recording 
of  a  case  study.    (The  dyads  identified  as  incompatible  in  the  I  channel 
listened  to  different  and  conflicting  versions  of  the  case  study.)  Each 
member  listened  independently  via  head-sets. 

After  the  case  study  was  presented,  the  individuals  were  taken 
to  a  small  group  discussion  room.  Their  task  for  this  second  part  was 
explained  to  them  verbally  and  the  problem  they  were  to  work  on  was 

'Compatibility  here  means  the  extent  to  which  individuals  mutually 
satisfy  each  others'  needs.    There  are  three  components  namely,  reciprocal, 
similarity  and  conflictual.    The  following  formulas  were  applied  to  the 
two  sets  of  questionnaires. 

Rij=  +   t«j  -  ^i^ 

=  (e^  -  ej.)  +   (w^  -  Wj) 

To  find  a  total  compatibility  score,  the  results  are  summed  together 
(Rij  +  C^-  -  ■•■  Sij).    The  term  w  means  subject  with  whom  one  would  like 
to  work  wSile  the  term  e  means  the  type  of  person  he  sees  himself  to  be. 

o 
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presented  on  a  typewritten  card.     The  discussion  was  1/2  hour  in  length. 
They  were  audio  and  video  tape  recorded.    Following  the  discussion  each 
individual  was  taken  to  a  separate  room  for  the  final  phase  of  the  experi- 
ment. 


Post-experiment  Phase:   There  were  three  (3)  tasks  in  this  final  phase. 
In  the  first  task  individuals  were  asked  (in  writing)  to  identify  the  ideas 
that  developed  during  the  disucssion,  who  originated  these  ideas,  and  hoiv 
the  ideas  were  received.   The  second  task  was  a  second  Semantic  Differential, 
This  Instrument  was  identical  to  that  in  the  Pre-experiment  Phase  except 
the  concept  was  changed  to  "the  person  I  worked  with".   The  third  task  was 
to  distribute  a  sixty-four  (64)  card  Q  sort  according  to  whether  the 
statements  on  the  cards  described  their  group  or  not.   That  is,  a  forced 
distribution  on  a  continuum  from  'least  like  my  group'  to  'most  like  m 
group'.    Each  card  is  'loaded'  to  represent  one  of  the  three  (M,  D,  I) 
channels  more  than  the  other  two. 

Reliability  of  Coders 

Three  judges  were  trained  to  code  the  post-meeting  reports.  It 
was  determined  that  judges  must  reach  c.  surpass  a  .70  on  the  Guetzkoivf 
Correctness  of  Categorizing  (1950)  before  leaving  the  training  materials. 
To  insure  they  maintained  at  least  this  level  during  the  coding  of  the 
data  each  was  assigned  a  randanTy  selected  set  of  20  dyads  with  4  of 
each  set  of  20  being  coir«non.    The  reliability  among  coders  was  maintained 
throughout  the  coding  of  all  data. 


They  were  asked  to  assume  the  role  of  administrative  committee  mem- 
bers of  the  church  described  in  the  case  study.   Their  task  was  to  reach  a 
a  decision  on  the  problem  described  in  the  case  study.   The  problem  in  the 

FRir  case  study  centered  around  conflicting  philosophies  of  an  older,  conserva- 

££yi^  tlve  minister  and  a  young,  progressive  minded  minister. 
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Findings 

It  could  be  posited  from  the  theory  that  those  members  who  were 
most  compatible  would  demonstrate  a  high  association  between  their  ideal 
conception  of  a  msmber^and  the  person  with  whom  they  were  paired.   As  the 
compatibility  between  sets  of  members  decreased  so  also  would  the 
association  between  a  measure  of  an  ideal  group  member  and  the  paired 

mber.   The  means  and  rank  order  on  the  types  of  dyads  are  reported  in 
Table  Z.    A  Kendall  Tau  statistic  was  computed  on  the  rankings. 


TABLE  2  GOES  ABOUT  HERE 


The  ranking  revealed  a  Tau  equal  to  .25.    Although  the  result  does 
not  support  the  conjecture  in  a  strict  statistical  interpretation  it  is 
clearly  and  sufficiently  indicative  to  argue  against  the  rejection  of 
the  theory.    The  results  indicate  that  members  who  are  higher  on  measures 
of  compatibility  will  show  a  closer  association  between  their  ideal  member 
perception  and  the  member  with  whom  they  are  compatible.    While  dyad  types 
1  and  2  were  ranked  highest  as  was  predicted  there  remains  the  question 
why  did  members  in  dyad  types  7  and  8  rank  each  other  more  favorably  than 
dyad  types  3,  5  and  6?  At  this  time  the  only  answer  that  can  be  given  is 
that  the  results  warrant  further  study. 

It  was  conjectured  that  differeing  groupings  of  conpatibilities 
would  affect  what  the  dyad  members  reported  in  describing  their  dyad 
session  in  terms  of  the  three  channels.    Five  subsidary  hypotheses  were 
proposed  to  test  this  conjecture* 


The  hypotheses  ivere  tested  by  means  of  a  64  card  0  sort.  Individuals 
were  requested  to  distribute  the  cards  in  a  forced  normal  distribution  along 
a  con'.inuum  from  least  to  most  descriptive.    There  were  six  cards  in  each 
of  the  two  stacks  at  the  ends  of  the  distribution.    The  total  of  12  cards 
provided  the  raw  data  for  the  analyses. 

Three  results  corroborate  the  theory.    It  was  predicted  that  dyads 
with  high  compatibility  on  all  three  channels  would  describe  their  sessions 
more  in  terms  of  the  positive  I  channel  than  any  other  types  of  dyads.  It 
was  predicted  that  dyads  with  low  compatibility  on  the  D  channel  only 
would  describe  their  group  more  in  terms  of  the  D  channel  than  any  of  the 
other  types  of  dyads.    The  means  for  this  dyad  type  were  lowest  for  ;i  and 
I  channel  which  further  supports  the  hypothesis.    Dyads  which  were  con- 
sidered incompatible  on  the  H  channel  only  were  predicted  to  describe  thair 
group  more  in  the  M  channel  than  in  the  other  channels.    This  was  found  to 
be  the  case,  however,  all  other  groups  were  higher  on  the  H  channel.  These 
results  will  be  reviewed  in  the  discussion  section. 

The  second  subsidiary  hypothesis  asserted  that  the  members  of 
dyads  which  v/ere  incompatible  on  the  I  channel  only  would  describe  their 
sessions  on  all  three  channels  in  relatively  equal  terms.    Members  of  this 
type  of  dyad  described  their  session  much  more  in  terms  of  the  M  channel 
than  the  I  channel. 

Finally  groups  considered  incompatible  on  two  or  more  channels 
were  predicted  to  describe  their  group  sessions  in  terms  of  the  M 
channel.    The  results  were  as  predicted.    It  Is  to  be  pointed  out,  however, 
that  all  dyad  types  described  themselves  more  In  terms  of  the  H  channel 
than  any  other  channel.    An  Interpretation  of  this  result  Is  presented 
In  the  discussion  section. 
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The  third  hypothesis  was  in  fact  three  subsidiary  hypotheses.  All 
three  hypotheses  posited  the  condition  that  the  dyad  types  were  described 
by  a  measure  providing  a  continuum  of  high  to  low  compatibility.  The 
data  that  served  as  the  dependent  variable  were  the  post-meeting  reports 
written  independently  by  all  members.    It  was  conjectured  that  there  would 
be  a  positive  association  between  the  measure  of  compatibility  and 

1.  statements  reporting  jointly  developed  contributions. 

2.  the  absence  of  statements  reporting  references  to  his  own 
contributions  as  separate  entities. 

3.  the  absence  of  statements  reporting  references  to  alter* s 
contributions  as  separate  entities. 

The  rank  order  of  the  8  dyad  types  were  determined  and  the  Kendall  Tau 

was  employed  to  test  for  the  level  of  statistical  significance.  The 

Kendall  Tau  statistic  for  the  three  sets  of  rankings  were  .43,  .04  and  .44 

respectively.    The  results  for  tv.-o  of  the  subsidiary  hypotheses  (1  and  3) 

indicate  support  for  these  conjectures  and  in  turn  for  the  theory. 

Specifically,  groups  higher  in  measures  of  compatibility  perceive  more 

mutually  developed  contributions  than  those  having  lower  compatibility. 

This  result  is  consistent  with  the  theory.    Incompatibility  produces 

more  noise  in  a  social  system.    As  the  noise  in  the  social  system  increases 

the  possibility  of  perceiving  mutually  developed  contributions  decreases. 

Two  of  the  tests  corroborate  this  argument.    The  results  for  hypotheses 

2  were  in  the  predicted  direction  but  at  a  level  for  below  that  which 

would  give  us  much  confidence  in  the  prediction  of  an  association 

One  of  the  major  points  posited  by  tne  theory  is  that  the  I 

channel  plays  a  less  significant  role  in  the  transactions  of  a  group  than 

do  the  other  two  channels.    There  was  one  result  which  appears  to  provide 

< 

substantial  evidence  in  support  of  the  theory.    Twenty  of  the  40  dyads 
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were  given  conflicting  case  study  materials.   The  reader  will  recall  that 
one  member  of  dyad  types  2,  5,  6  and  8  listened  to  case  study  A  while  the 
other  member  listened  to  case  study  B.   Yet  in  not  one  of  these  20  dyads 
did  the  members  openly  identify  or  even  question  whether  both  members 
heard  the  same  case 'study. 

Discussion 

The  transactional  theory  proposed  by  Boyd  should  be  viewed  in  the 
context  of  what  Popper  (1963)  calls  power  of  a  theo**y.    Popper's  idea  may 
be  stated  in  simple  terms  in  the  following  manner.   As  "we  operate  with 
theories  of  increasing  content,  it  must  also  mean  we  operate  with 
theories  of  decreasing  probability."^   The  arument  for  this  position  is 
that  our  aim  is  the  growth  of  knowledge  and  not  the  design  of  experiments 
which  yield  high  probability.   The  over-  concern  for  obtaining  high  probabil- 
ity leads  logically  to  theories  of  decreasing  content.    It  is  argued  here 
that  this  should  not  be  our  aim.   The  aim  of  science  is  a  high  informative 
content. 

Taking  this  position  does  not  in  any  sense  imply  that  conjectures 
formulated  within  a  theory  are  safe  from  empirical  testing.   The  scientific 
quality  of  any  theory  is  directly  correlated  with  the  falsifiability  of  its 
conjectures. 

The  theory  which  Boyd  has  set  forth  is  a  theory  of  increasing  content. 
The  theory  should  be  viewed  as  an  attempt  at  the  integration  of  much  sol  id 
work  by  serious  scholars.   This  reported  investigation  is  seen  as  an 

^Karl  Popper,  Conjectures  and  Refutations;   The  Growth  of 
Scientific  Knowledge,    p.  218. 
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initial  sortie  in  the  testing  of  the  theory.    To  view  it  otherwise  would 
distort  the  study  out  of  perspective  and  may  run  the  risk  of  ignoring 
substantial  contributions  made  by  other  researchers. 

In  summary  there  was  a  trend  for  dyad  types  to  be  ordered  from 
more  compatible  to  less  compatible  on  a  congruency  measure  between  v^hat 
type  of  co-worker  each  member  wanted  and  the  actual  member  he  worked 
with.    It  was  not  a  totally  consistent  trend.    Perhaps  the  most  critical 
insight  into  the  results  was  the  proposal  that  the  time  of  the  trans- 
actions between  the  members  was  too  brief  to  develop  significant  involve- 
ment in  order  to  get  a  more  powerful  reading.    The  rank  order  results  were 
fairly  consistent  when  compared  with  the  order  predicted  (Tau  =  .25). 
Although  the  results  cannot  be  seen  as  impressively  supportive »  they  must 
be  viewed  In  terms  of  the  scope  of  events  the  theory  denies.    The  increased 
content  of  theory  increases  the  opportunities  of  falsifying  it.    From  this 
perspective  the  results  clearly  justify  the  holding  of  the  theory  for 
further  testing. 

The  second  test  of  the  theory  examined  the  conjecture  that 
various  types  of  compatibility  would  effect  the  transactions  of  the  dyads 
In  specific  ways.    Five  subsidary  hypotheses  were  proposed  and  tested. 
Three  sets  of  results  corroborated  the  theory,  while  two  sets  of  results 
presented  conflicting  evidence.    In  dyads  where  compatibility  is  high  on 
all  three  channels  the  members  perceive  their  sessions  dealing  with  the  work 
dimension.    The  theory  would  propose  that  dyads  having  low  conf)atibility 
only  on  the  D  channel  would  describe  their  session  more  in  this  dimension 
than  any  other  dimension.    This  aspect  of  the  theory  was  corroborated. 
Similarily  dyads  having  low  compatibility  on  the  lA  channel  only  would 
describe  their  session  more  In  this  dimension.    This  was  found  to  be  the 
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case.    There  were  additional  findings  which  bear  on  the  theory.    It  was 
posited  that  the  H  channel  is  of  fundamental  concern  and  would  accordingly 
receive  most  attention.    In  dyads  where  M,  HI  or  01  were  low  in  compatibil- 
ity,  the  members  described  their  dyads  more  in  the  M  dimension  than  in  any 

> 

dimension.    These  findings  are  clearly  corroborative  of  the  theory. 

It  was  predicted  that  the  members  of  (ilyads  incompatible  only  on 
the  I  channel  would  describe  their  sessions  in  terms  of  all  three  channels 
relatively  equally.    They  describe  tlieir  session  much  more  in  terms  of 
the  M  channel  than  either  of  the  other  two  channels.    It  was  reasonsed 
that  when  there  exists  a  high  level  of  compatibility  on  fi  and  D  channels 
dyads  are  freer  to  concentrate  on  the  I  channel.    This  appeared  to  be 
consistent  with  the  theory.   One  explanation  may  be  that  members  spend 
much  time  initially  in  determining  the  relationships  in  the  M  and  D 
channels  and  leave  tha  resolution  of  the  I  channel  last.    Longer  time  periods 
for  the  dyads  would  test  this  interpretation.    It  should  be  pointed  out  that 
this  set  of  dyads  (I  incompatible  only)  gave  more  negative  descriptions  of 
their  I  channel  than  all  other  types  of  dyads.   This  may  be  interpreted 
to  mean  they  saw  their  incompatibility  in  this  channel  more  clearly  than 

all  other  dyads.  j 

j 

It  was  predicted  that  dlyad  types  low  on  two  or  more  compatibility 
measures  would  describe  their  sessions  in  terms  of  the  M  channel.  The 
results  corroborate  this  hypothesis,  however,  all  dyads  members  described 
their  dyads  more  in  terms  of  the  M  channel  than  any  other  channel.  This 
finding  weakens  the  test  of  the  hypothesis.   Although  the  specific  hypothesis 
remains  to  be  tested  more  rigorously  the  results  do  point  to  the  central 
position  the  M  channel  plays  in  the  type  of  group  which  was  studied. 

ERIC 
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The  final  test  of  the  theory  posited  a  positive  association  between 
measures  of  compatibility  and  a  post-meeting  report.    It  was  reasoned  that 
the  higher  the  compatibility  the  more  the  dyad  members  would  describe 
contributions  as  being  jointly  developed.    That  is  to  say,  such  members 
would  play  down  credit  for  individual  members.    Three  sub-tests  which 
examined  this  conjecture  from  different  perspectives  gave  results  in  the 
direction  predicted.   Two  results  indicate  fairly  strong  support  for  the 
general  conjecture  (Kendall  Tau  =  .43  and  .44).  . 

The  theory  proposed  that  the  higher  the  compatibility  among  the 
three  channels  the  higher  would  be  the  cohesiveness  in  the  group. 
Cohesiveness  in  turn  provides  a  climate  in  which  mutuality  can  be 
developed  and  appreciation  of  other  members'  contributions  is  fostered. 
The  results  appear  to  support  this  line  of  reasoning  and  the  three  channel 
transactional  theory  provide  an  explanation  for  the  condition  of 
cohesiveness  in  small  groups. 

One  of  the  most  startling  findings  was  that  not  in  any  one  of  the 
20  dyads  whose  members  had  heard  distinctly  different  versions  of  the  case 
stu4y  did  the  members  identify  or  even  question  whether  both  members  heard 
the  same  case  study.    In  view  of  the  fact  that  the  members  were  together 
for  a  half  hour  discussion  and  that  the  two  versions  had  striking  con- 
flictual  material  it  is  reasonable  to  hold  to  the  argument,  at  least 
tentatively,  the  members  of  dyad  types  2,  5,  6  and  8  must  have  been  giving 
more  of  their  attention  to  other  communication  problems  than  those  in  the 
I  channel.    Since  dyad  types  5,  6  and  8  were  non-compatible  on  one  or 
more  of  the  other  channels  it  could  be  argued  that  the  noise  from  the 
other  non-compatible  channel  prevents  these  dyads  from  recognizing  the 
existence  of  the  two  versions  of  the  case  study.    This  interpretation  does 

ERIC 
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not  hold  for  dyad  type  2  because  the  other  channels  were  classified  as 
compatible.   Again  we  must  return  to  the  explanation  that  channels  M  and  D 
present  such  central  and  immediate  problems  even  for  compatible  dyads 
that  until  the  compat1';ility  is  perceived  by  the  members  they  are  not 
free  to  move  to  probloms  on  the  !  channel.    This  reasoning  is  consistent 
with  the  theory  but  ous"  results  then  force  upon  us  a  serious  criticism  of 
the  design  of  the  experiment.   One-half  hour  discussion  period  may  be 
insufficient  to  provide  time  for  members  to  work  through  perceptions  of 
each  other's  life-style  as  given  in  the  configurations  of  the  M  and  D 
channels. 
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COMMUNICATING  WITH  LOW  INCOME  PEOPLE: 
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Montreal,  April  1973.  Research  reported  in  this  paper  was 
supported  by  Federal  Hatch  Funds  and  the  New  York  State 
College  of  Agriculture  and  Life  Sciences. 


Our  university  and  Canada  have  at  least  tw^o  important  things  in 
common.    First,  hockey  is  a  major  craze  of  both.     (In  fact  Cornell's 
hockey  team  itself  is  very  Canadian.)    And  we  also  share  a  major 
concern  in  exploring  v/ays  of  communicating  with  hard-to-reach  people. 

Only  last  November,  Canada  forged  a  new  link  with  people  in  the 

Canadian  North  with  the  launching  of  the  nation's  first  communication 

satellite.     It  was  appropriately  named  ANIK,  the  Eskimo  vjord  for 

"brother."    Shortly  before  that  time,  the  Minister  of  Communications, 

the  Honourable  Robert  Stanbury  told  a  Royal  Society  of  Canada  Special 

Symposium  on  "Communications  .  in  .  the  Home"  that  in  a  visit  to  the 

remote  areas  of  the  Yukon  and  Northv/est  Territories,  he  found 

...  along  with  an  appealing  zest  for  northern  life,  a 
deeply  felt  sense  of  deprivation  and  separation  from 
the  Canadian  mainstream.    There  is  in  this  isolation  a 
lack  of  contact  ;^ith  others  in  neighboring  communities 
only  a  few  miles  removed  in  physical  terms  but  separated 
by  a  lAfide  chasm  in  terms  of  ability  to  communicate  by 
any  means  except  the  "moccasin  telegraph."! 

ANIK  constituted  another  important  effort  to  bring  the  people  of  the 

North  into  closer  contact  i^ith  the  rest  of  Canada. 

Our  efforts  at  Cornell  to  communicate  with  hard-to-reach  people 

involve  technology  less  dramatic  than  the  ANIK  satellite.    The  heart 

of  our  program  is  a  very  modest  $1  cassette  tape  and  a  $25  cassette 

playback  unit.    Yet,  we  have  hopes  that  our  research  on  this  Cassette 

Special  Communication  System  (CSCS)  will  give  some  clues  as  to  how 

simple  communication  technology  can  provide  communities,  whether 

isolated  by  geojraphy  or  by  culture,  the  opportunity  to  share  in  some 

of  the  benefits  of  mainstream  society. 

■'"Robert  Stanbury,  P.C.,  M.P.  Opening  Address,  Communications  in 
the  Home 3  Proceedings  of  the  Special  Symposium,  Royal  Society  of 
Canada,  Ottawa,  March  1972. 
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Background  of  CSCS 

CSCS  grew  out  of  a  concern  for  developing  a  cooperative  research 
program  amon:;  land  grant  universities  in  the  riortheastern  United 
States  that  would  focus  on  problems  of  low  income  people.  This 
became  known  as  Northeast  Project  67  -  Paths  Out  of  Poverty.     One  of 
the  several  Cornell  components  dealt  specifically  with  problems  of 
commxinication.      The  Cassette  Special  Communication  System  was 
designed  to  try  to  bring  to  low  income  people  information  in  appro- 
priate  "packaging"  -chat  would  help  them  use  their  own  and  their 
communities'  resources  to  improve  their  lives. 

When  we  initiated  CSCS  studies  at  Cornell,  we  planned  a  signifi- 
cant role  for  indigenous  paraprofessional  "advisors"  in  the  develop- 
ment and  implementation  of  the  projects.    Though  not  trained  in 
research  methods,  they  have  made  valuable  contributions  in  designing 
and  evaluating  the  research  projects.    We'll  turn  to  that  in  a 
moment . 

The  basic  CSCS  plan 

We  must  emphasize  in  talking  about  CSCS  that  it  is  a  system.  It 
involves  audio  cassette  technology,  but  equally  important,  it  involves 
a  plan  for  '"^eveloping  the  softv/are  and  strategies  for  dissemination. 

An  important  emphasis  in  CSCS  is  putting  greater  control  over 
the  communication  process  into  the  hands  of  those  who  are  the  so- 
called  "targets"  of  information  programs.    In  fact,  one  of  the  more 
exciting  developments  on  the  frontiers  of  communication  is  not  so 
much  the  technology  per  se,  but  the  increasing  opportvinity  it  provides 
for  greater  independence  from  those  creating  and  sending  messages. 
We  see  this  in  the  increasing  use  of  study  carrels  in  schools,  in  the 
development  of  television  videocassette  and  video  disc  systems  which 
will  eventually  release  television  viewers  from  the  arbitrary  sched- 
uling of  programs  by  networks  and  stations;  and  in  the  creative  use 

 P  ^  ' 

In  addition  to  the  research  discussed  in  this  paper,  other 
communication- related  studies  are  reported  in  Ivette  Puerta  and 
Robert  L.  Bruce,  Data  Collection  with  Low  Income  Respondents,  a  paper 
presented  at  the  Adult  Education  ResearcTi  Conference,  Chicago,  1972; 
and  Njoku  E.  Awa,  Some  Factors  Related  to  Communication  and  Social 
Participation  in  Low  Income >  Low  Density  Populations,  unpublished 
Ph.D.  dissertation,  Cornell  University,  1973* 
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of  audio  cassettes  for  speeches,  lectures,  and  other  oral  presenta- 
tions . 

Obviously  tape  recording  equipment  is  not  new.    It's  been  around 
for  about  25  years.    But  cassette  equipment,  v^rhich  began  to  appear  on 
the  market  in  the  mid  sixties  as  a  moderately  expensive  instrxoment, 
was  by  the  early  seventies  saturating  the  consumer  marketplace. 
Therein  lies  a  major  reason  why  cassette  technology  has  been  so  impor- 
tant In  developing  CSCS.     In  CSCS,  cassette  tape  units  are  placed  in 
the  households  of  the  special  audience  and  pre-recorded  tapes  are 
provided  for  them.    Audio  cassette  machines  are  simple  to  operate  and 
relatively  inexpensive  to  buy.    Playing  a  tape  is  an  elementary  task; 
there  is  no  threading  or  handling  of  the  tape  itself.    In  one  test  in 
Pakistan,  a  researcher  discovered  that  the  skill  of  operating  the 
machine  can  be  taught  even  to  an  illiterate,  -^o^  moderately  intelli- 
gent person  in  five  to  eight  minutes,^ 

It  was  this  simplicity  and  low  cost  of  the  cassette  system  that 
permitted  us  to  shift  some  control  of  the  communication  process  to 
the  receiving  community,    A  little  later  we'll  see  what  this  means  to 
the  listening  context.    Although  we  have  not  experimented  with  it  yet, 
it  is  also  possible  to  provide  a  system  of  feedback  if  the  machines 
have  both  record  and  playback  capability  (v/hich  most  units  on  the 
market  do) , 

The  collaboration  of  indig;enous  advisors 

In  the  four  counties  where  we've  been  working  with  CSCS,  the 
Cornell  team  has  never  had  direct  contact  with  those  low  income 
people  who  were  to  receive  the  units  and  the  tapes.    We  sought  repre- 
sentatives from  the  lovj  income  community  to  assist  in  all  phases  of 
the  project.    Use  of  indigenous  people  in  community  education  and 
information  projects  is  certainly  not  new.    One  report  notes  that  the 
1920 's  "witnessed  a  very  great  expansion  in  the  use  of  local  leaders, 
with  which  there  had  already  been  limited  but  successful  experience, 

^  .  - — ~  

^S,  Mahmud  Roshen,  Tape  Playback  Machine  Project,  paper  prepared 

for  the  ROD  Seminar  on  Family  Planning,  Islamabad,  October  1969, 

P-  5. 
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particularly  with  the  demonstration  work  amon??  women."    One  group  of 
these  local  leaders  was  made  up  of  "persons  who  were  recognized  as 
representatives  of  a  community  or  township  to  receive  from  the  spe- 
cialist or  home  demonstration  agent  training  in  subject  matter  and  in 
methods  of  presentation^  which  in  turn  they  would  pass  on  to  their 
own  groups. 

Use  of  indigenous  paraprof essionals  is  a  distinguishing  mark  of 
social  intervention  programs  of  the  1960's  and  1970' s.    Part  of  the 
impetus  in  the  United  States  came  from  political  decisions  to  encour- 
age employment  of  low  income  people  in  Federally  funded  anti-poverty 
programs.    A  simultaneous  drive  came  from  the  realization  by  social 
action  people  that  a  gulf  existed  between  the  "establishment"  types 
and  the  client  group ^  and  that  one  wa;^  of  bridging  that  gap  v;as  to 
use  some  of  the  target  group  members  themselves  as  communication 
links.    Thus^  we  see  in  various  communities  "nutrition  aides/' 
"community  aides>"  "health  aides,"  etc. 

In  using  the  indigenous  person  as  an  advisor,  CSCS  puts  emphasis 
on  having  that  person  help  develop  content  and  plan  strategy,  rather 
than  serving  primarily  to  relay  material  designed  by  people  outside 
the  community.     In  this  v\ray,  the  community  is  actually  making  an 
input  (through  the  advisors)  at  the  intial  stage  of  the  communication 
process.    This  is  another  \ray  of  giving  the  community  a  greater 
measure  of  ^^ontrol  over  the  communication  process. 

Beginning;  of  the  advisors'  role:    creating^  content 

In  starting  a  CSCS  project,  v/e  usually  begin  by  meeting  with  a 
group  of  advisors  in  an  informal  setting.    We  explain  the  system  to 
them  and  play  some  sample  tapes.    Then  we  discuss  ^^^hat  they  think 
people  like  them  in  the  community  need  to  know  to  make  their  lives 
better.    In  three  of  the  five  counties  where  we've  been  working,  our 
advisors  have  been  nutrition  aides  so  they  have  had  a  good  chance  to 

^Edmund  deS.  Brunner  and  E.  Hsin  Pao  Yan,^,  Rural  America  and  the 
Extension  Service,  Teachers  College,  Columbia  University,  19^9> 

pp.79-ao. 
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circulate  in  the  community.     Once  warmed  up,  they  easily  generate  a 
list  of  topics  that  Is  ample  for  the  project. 

The  advisors  also  help  with  the  question  of  what  manner  of 
presentation  will  be  used  on  the  tapes:    interview^  drama,  straight 
talk,  conversation,  etc.     In  one  pro ject^^^^e^dvisors  came  up  with 
a  "soap  opera"  format  and  "created"  the^family  members  and  the  typical 
problems  each  of  them  v/ould  have.    What  v/as  happening  (v;e  think)  in 
this  kind  of  a  work  session  was  that  the  advisors  were  creating  plot 
ideas  out  of  their  own  experiences  and  those  of  their  clients  in  the 
community. 

Our  task  is  then  to  research  the  topics.    This  involves  checking 
with  health  agencies,  lav;  libraries,  public  officials,  community 
groups,  university  specialists,  etc.,  for  accurate  information  on  the 
topics  selected.    We  then  try  to  put  the  information  into  the  proper 
form  for  the  target  audience. 

Language  is  an  important  consideration  in  the  development  of 
content.    It*s  not  only  what  language  to  use  (we've  been  working  in 
English  and  Puerto  Rican  Spanish)  but  what  words  in  the  language.  Do 
we  use  "supper"  or  "dinner"  to  refer  to  the  evening  meal?    Do  we  use 
the  word  "poor"  'co  describe  low  income  people?    Do  we  use  the  phrase 
"disadvantaged  children"?    Often  it's  the  advisors  who  catch 
improperly  used  words. 

The  importance  of  having  an  indigenous  person  advise  on  wording 
is  illustrated  by  an  incident  in  a  Philippine  barrio  where  Rural 
Reconstruction  Movement  (RRM)  people  were  trying  to  push  a  literacy 
program.    Obviously  they  had  to  identify  the  illiterates.    As  Juan 
Flavier  reports  the  story,  the  literacy  movement  was  proceeding  very 
slowly  in  the  barrios  despite  the  fact  that  Filipino  farmers  attached 
great  importance  to  education.    For  them,  it  was  the  only  v/ay  out  of 
their  poverty.    So,  v/hy  the  great  difficulty  in  the  literacy  drive? 

A  clue  came  when  Flavier  and  the  RRM  workers  stumbled  onto  the 
full  meaning  of  the  Tagalog  word  for  illiterate.    It's  "mangmang." 
In  English  the  word  illiterate  means  "the  inability  to  read  and 
write."    Mangmang  means  this  and  more:    it  also  implies  stupidity. 
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"In  other  words^"  says  Dr.  Flavier,  "i^/hen       asked  who  were  the 
illiterates  or  man^mang  in  the  barrios,  we  were  in  effect  askin^^  who 
were  the  *  stupids '."^ 

Content  characteristics 

We  found  that  CSCS  offered  some  distinct  advantages  in  develop- 
ing content.    For  example;,  the  system  lends  itself  to  quite  limited 
areas  of  circulation.    This  means  that  content  can  be  localized.  We 
were  able  to  use  specific  names  of  county  agencies,  names  of  local 
people;,  and  references  to  other  v/ell-knov/n  features  of  the  local 
culture  and  environment.    We  have  a  hunch  that  this  approach  is  more 
meaningful  than  providing  messages  that  have  no  local  flavor.^ 

We  also  use  "homophily"  approaches  with  which  the  listeners  can 

easily  identify,  but  also  inserted  elements  of  "heterophily"  to 

7 

provide  what  Rogers  calls  competence  credibility. ' 

Because  of  the  opportunity  for  people  to  listen  to  the  tapes  in 
their  own  households  (or  wherever  they  pleased),  it  is  possible  to 
use  quite  intimate  and  personal  material  such  as  family  planning  and 
venereal  disease  information.    Often  this  kind  of  information  is  too 
sensitive  for  broadcasting  on  a  radio  or  television  station. 

A  key  effort  is  made  to  make  the  content  interesting  and  enter- 
taining.    One  technique  is  to  include  music  appropriate  to  the  area 
in  which  the  tapes  are  to  be  used. 


-^Juan  M.  Flavier,  Doctor  to  the  Barrios ^  New  Day  Publishers, 
Quezon  City  (Philippines),  1970,  p.  171. 

We  aren't  alone  in  this  view.    An  unpublished  proposal  by 
Population  Services,  Inc.,  puts  it  this  way:     "Testimonials  by  local 
villa:^3  people  would  support  the  claims  of  the  field  workers  and 
legitimate  their  activities  regarding  a  subject  which  is  often 
regarded  with  suspicion  and  skepticism.    Even  if  the  message  can  be 
carried  to  large  audiences,  the  problem  of  relevance  remains.    A  mass 
message  prepared  for  one  audience  in  a  developing  country  often  car- 
ries little  weight  with  an  audience  in  another  locale.    Thus  the 
impact  of  a  promotional  campaign  may  be  seriously  eroded  by  the 
inability  of  large  sections  of  the  society  to  identify  with  its  pur- 
poses.   For  the  majority  of  people,  credibility  begins  at  the  village 
boundary. " 

'^Rogers  discusses  the  concepts  of  homophily  and  heterophily  in 
Everett  M.  Rogers  and  F.  Floyd  Shoemaker,  Communication  of  Innova- 
tions, The  Free  Press,  New  York,  1971. 
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And  CSCS  allov;s  flexibility •  ^^Jhatever  time  it  takes  to  ^et  a 
message  across,  two  minutes  or  five^  there  are  relatively  few  con- 
straints in  CSCS* 

A  typical  tape  contains  about  20  minutes  of  recorded  material  on 
each  side*^    This  usually  includes  three  or  four  "episodes"  which 
have  the  important  information  in  them,  with  selections  of  music 
between  episodes*    A  typical  episode  has  a  teaser  announcement  of 
about  one  line  ("Do  you  know  where  you  can  get  low  cost  medical  serv- 
ice in  Yates  County?")  followed  by  a  dramatization  or  interview  or 
monologue^  always  done  by  people  vfho  sound  like  the  listener  (homo- 
phi  ly)*    Then  there  is  a  summary  delivered  by  a  person  with  a  strong, 
clear ^  resonant  voice.    This  latter  element  provides  both  the  restate- 
ment of  the  facts  from  the  preceding  section,  and  the  ring  of 
authority  (an  heterophily  element). 

In  our  effort  to  make  the  tapes  interesting  and  entertaining^  v/e 
put  a  considerable  amount  of  music  in  them.    Again  it  was  the  advisors 
who  guided  us  in  the  selection  of  music.    And  well  they  do,  as  I'll 
relate  in  a  moment. 

A  distribution  strategy 

Finally,  over  a  period  of  several  sessions  with  our  advisors,  we 
design  a  system  for  getting  tapes  and  cassette  units  to  the  community. 
We're  not  sure  yet  what  kind  of  pattern  works  best  v/here.    In  our 
first  study  we  used  what  we  call  the  Yates  pattsrn.     In  this,  each 
advisor  is  responsible  for  placing  the  cassette  unit  in  n  low  income 
home.    He  may  have  15  or  20  machines  for  placement.    Tapes  are  sent 
periodically  by  the  advisor  to  each  home.    At  the  end  of  the  test 
period;,  the  advisor  recovers  the  unit  and  the  tapes. 

A  variation  called  Ontario,  follows  the  same  scheme  but  includes 
small  follow-up  group  meetings  involving  those  who  have  been  listen- 
ing to  the  tapes.    This  is  similar  to  the  radio  rural  forum  idea  that 
started  more  than  20  years  ago  here  in  Canada  and  was  adopted  by 
India  and  other  developing  nations. 

Essex  is  the  name  of  a  distribution  pattern  in  which  the  advisor 
starts  a  unit  off  with  one  household,  and  instructs  a  person  in  that 

-  '   '    ' " — 

See  the  accompanying  diagram. 
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household  to  pass  it  on  to  another  household  after  they  are  finished 
v;ith  it*    Let  me  pause  for  a  moment  to  indicate  how  helpful  advisors 
are  in  the  development  of  the  project  strategy.    The  initial  reaction 
to  the  Essex  plan  v/as:     ''Oh  boy^  you'll  never  see  those  machines 
again.    They'll  go  right  out  of  the  county."    But  on  reflection,  the 
advisors  who  first  dis^mssed  this  system  framed  three  hypotheses 
about  Essex*     (Remember  these  are  lov;  income  aides  with,  at  most,  a 
high  school  education*) 

1.  Loss  of  equipment  would  be  small  because  the  people 
handling  the  equipment  and  passing  it  on  to  others 
v70uld  feel  responsible  for  the  equipment*  They 
v;ould  be  likely  to  pick  households  that  were  also 
dependable  and  responsible* 

2.  As  the  units  and  tapes  were  passed  from  household 
to  household,  they  v/ould  begin  to  enter  households 
of  higher  socio-economic  people.    In  short,  the 
system  v;ould  circulate  up  the  socio-economic 
ladder. 

3.  When  a  person  passes  a  unit  and  tapes  to  another 
household,  they  are  passing  more  than  equipment. 
They  are  also  passing  on  an  implicit  testimonial 
about  the  value  of  v/hat  was  on  the  tapes. 

When  we  heard*  these  kinds  of  ideas  coming  from  our  advisors,  we 

wondered  why  some  of  our  college  students  weren't  as  alert. 

One  other  distribution  pattern  is  Brooklyn.    It  is  even  more 
like  the  radio  forum  idea*    It  involves  having  t'^e  advisor  play  the 
tapes  for  people  gathered  together  in  a  small  group.    But  to  preserve 
the  idea  of  giving  the  receiver  independent  control  over  the  receiv- 
ing process,  each  member  of  the  group  is  given  the  chance  to  borrow  a 
unit  and  tapes  to  take  home  for  repeat  and  additional  listening. 

After  we  have  a  chance  to  find  out  more  about  each  of  these 
patterns  and  how  they  v/ork,  it  will  be  easier  to  match  up  a  system 
with  characteristics  of  the  community.    For  example^  the  Brooklyn 
might  be  best  for  a  densely  populated  area  such  as  an  urban  housing 
complex^  \/hile  Essex  might  be  more  suitable  for  a  remote  rural  area 
such  as  a  village  in  Nepal. 


-  10  - 


Pretesting 

The  aclvisors  play  an  extremely  important  role  in  pretesting  the 
tapes.    They  take  them  to  their  ovm  homes,  and  to  neighbors  and 
friends  in  the  community.    They  collect  comments  and  suggestions  which 
they  feed  back  to  us.    We  then  make  whatever  modifications  are  nec- 
essary in  the  tapes.    In  one  case  we  thought  we  had  guessed  correctly 
on  the  kind  of  music  to  use  in  the  tapes.    It  was  country  and  v;estern, 
and  the  first  night  we  played  it  for  the  advisors,  they  reported  (as 
they  tapped  their  toes  to  the  beat)  that  this  was  excellent  music  for 
the  project.    After  they  had  been  in  the  community  pretesting  the 
materials,  they  told  us  to  change  the  music.    The  sentimentality  of 
the  C&W  music  seemed  inappropriate  for  the  low  income  homes  in  the 
community,  many  of  which  had  broken  families.    Thus,  we  shifted  to 
"bluegrass  music"  v/hich  has  an  upbeat  tempo. 

CSCS  into  the  home 

With  the  tapes  polished,  the  advisors  are  given  the  materials  to 
get  the  project  into  the  field  for  testing.    Depending  on  the  type  of 
evaluation  design  we  have  devised,  they  may  also  take  materials  for 
interviewing  householders  with  whom  ''le  \inits  will  be  left.  Through- 
out the  field  operations  it  is  the  advisor  who  supplies  tapes  and 
makes  contact  with  the  people  in  the  project. 

Once  the  cassette  materials  are  in  the  household,  note  how  the 
person  receiving  can  control  the  consumption  pattern.    This  includes 
the  time  of  exposure:     i.e.,  listening  can  take  place  during  a  bath, 
at  breakfast^  while  other  tasks  are  being  done  such  as  ironing,  v/ash- 
ing,  cooking;,  or  chopping  wood,  or  during  fishing.    And  it  can  be 
done  in  the  light  or  in  the  dark.    It  is  also  possible  to  listen  a 
second  or  third  time  to  the  content.    Thus  the  listener  can  control 
the  frequency  of  exposure  to  the  message.     (This  often  happened  in 
the  study  where  we  already  have  some  data  in.)    Also  important  is  the 
fact  that  the  system  is  literacy  free.    Although,  technically, 
literacy  is  no  problem  in  the  areas  we've  worked  so  far,  we  know  that 
there  is  a  disinclination  among  low  income  people  to  read  "social 
intervention"  literature.    So  far  we've  discovered  that  they  do  listen 
to  what  we've  packaged. 
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The  evaluation 

No  ideal  time  duration  has  been  determined  yet  for  having  a  CSCS 
project  in  the  fields    The  distribution  model  and  the  number  of  tapes 
i-/ill  have  an  influence  on  how  long  a  particular  cycle  is  in  the 
field.    We  left  the  playback  units  in  households  for  ei^ht  i^eeks  in 
our  Yates  trial,  which  was  conducted  in  a  rural  area.    If  this  viere 
an  already  proven  communication  system  bein^  used  by  a  local  agency, 
we  would  expect  that  once  the  advisors  brought  in  equipment  from  one 
eight-vreek  (or  other  len?;th)  cycle,  they  would  then  circulate  it  to 
other  households.    Eventually  the  first  households  might  get  the 
machines  back  again,  with  a  new  batch  of  tapes.    But  we're  still 
rather  far  from  recommending  CSCS  as  the  system  to  use  in  a  commu- 
nity's social  action  program.    We  still  have  much  evaluation  to  do 
and  some  questions  to  answer. 

In  our  most  recent  field  test,  we  used  the  Brooklyn  model  in  a 
crash  pro3ram  in  a  South  Brooklyn  housing  complex.    The  Brooklyn 
model  is  the  pattern  best  suited  for  rapid  diffusion,  and  ^'/e  used  it 
primarily  because  our  community  advisors  urged  us  to  put  material  on 
the  tape  dealing  with  an  imminent  local  school  board  election.  Our 
goal  was  to  reach  1,100  household  units  in  a  housing  complex  within  a 
week's  time,  using  Spanish  oni English  language  material.    We  are 
about  to  engage  several  low  income  indigenous  intervieviers  to  conduct 
an  evaluation,  and  frankly  are  a  bit  apprehensive  about  what  v/e  will 
find  in  terms  of  information  gain  and  behavioral  change.    We  had  not 
anticipated  the  need  to  work  on  such  a  rushed  basis  and  had  not 
really  considered  CSCS  as  a  medium  for  this  type  of  communication. 
One  hazard  with  field  studies  is  the  problem  of  control  and  the 
unexpected.    Yet,  from  informal  feedback  we  have  discovered  interest 
in  the  community  in  extending  the  system  to  a  community  health 
project  in  which  CSCS  will  be  used  in  conjunction  with  home  visits  of 
health  aides.    If  nothing  else  comes  out  of  this  study,  we  will  dis- 
cover something  about  the  problems  of  equipment  and  material  losses 
in  a  low  income  urban  setting  where  theft  and  robbery  are  common- 
place. 
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In  the  Yates  project  ;^e  v;ere  able  to  plan  and  organize  an 
evaluation  using  the  advisors  as  data  gatherers.    Although  v/e  used 
a  short  ansv/er  questionnaire  as  the  principal  evaluation  tool,  there 
was  no  writing  involved  in  the  interviews  conducted  with  the  target 
group  by  the  advisors.    The  advisors  used  the  questionnaire  as  an 
interviewer  schedule  and  recorded  the  questions  and  answers.    Later,  in 
their  o\m  homes,  the  advisors  listened  to  the  interviews  and  filled 
out  the  questionnaires.    Incidentally,  this  is  giving  us  a  chance  to 
spo^  check  and  compare  the  answers  given  on  the  tape  and  those  tabu- 
lated on  paper  by  the  advisor.    The  recording  also  gave  us  assurance 
that  evaluation  interviews  were  actually  conducted. 

Our  responsibility  was  to  take  the  evaluation  data  and  feed  the 
insights  it  revealed  into  our  next  projects.    We  also  made  it  a  point 
to  share  our  findings  with  those  who  were  key  elements  in  the  whole 
research  operation  —  the  indigenous  advisors. 

Questions  about  CSCS  and  advisors 

We  have  discussed  elsewhere  some  of  the  many  questions  which  our 
field  trials  of  CSCS  have  raised.^    Here  we  deal  v;ith  those  that 
relate  particularly  to  the  advisors. 

One  of  the  things  we  wonder  about  a  great  deal  is  how  CSCS  might 
change  the  role  of  a  paraprof essional  worker  who  has  one  specialty 
(e.g.,  agriculture  or  family  planning)  when  the  worker  is  equipped 
with  CSCS  bearing  information  on  other  subjects  (e.g.,  nutrition). 

What  effect  does  taking  part  in  the  development  of  tapes  and 
their  distribution  have  on  the  advif^ors'  actual  and  perceived  level  of 
competence?    (One  nutrition  aide  v/ho  has  been  working  on  tapes  with  us 
told  how  she  was  advising  someone  about  legal  rights  in  v^relfare.  We 
asked  her  how  she  learned  about  that  type  of  thing.    She  said  she 
learned  it  from  the  cassette  tapes  we  were  putting  together.) 

Related  to  these  questions  is  the  reaction  of  the  paraprofes- 
sionals'  clients:    are  they  willing  to  accept  and  trust  information 
brought  to  them  about  a  subject  they  kno^^^  is  outside  the  competence 
of  the  paraprofessional? 

^Royal  D.  Colle,  An  Experimental  System  for  Communicating;  With 
Hard>to-Reach  People^  paper  prepared  for  the  Second  Participaxits 
Workshop  on  Population  and  Family  Planning  Communication,  East-West 
Communication  Institute,  Honolulu,  January  1973. 
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Are  there  any  particular  characteristics  or  special  training 
that  a  CSCS-toting  community  worker  should  have? 

Conclusion 

One  of  the  early  reactions  we  got  from  a  group  discussing  the 
pros  and  cons  of  a  CSCS  project  was  the  problem  of  threatening  field 
workers  with  technological  obsolescence.    We  see  CSCS  as  a  partner 
with  the  field  v/orker  in  his/her  information,  education  and  communi- 
cation efforts.    We  discovered  one  supervisor  of  nutrition  aides  who 
thought  that  the  use  of  CSCS  would  provide  answers  to  non-nutrition 
questions  the  aides  are  asked  by  their  homemakers,  thus  releasing  "^.he 
aide  to  do  the  nutrition  education  she  was  supposed  to  do. 

As  one  looks  at  development  projects  around  the  wor^d,  there 
seems  to  be  a  commitment  to  the  field  worker  plan.    Yet,  it  is  dif- 
ficult to  train  field  workers  enough,  or  enough  field  v/orkers,  to 
handle  the  kinds  of  information  and  education  that  are  necessary  in  a 
total  development  program.    With  a  tool  like  CSCS,  the  intimate, 
personal  contact  of  the  f lesh-and-blood  field  worker  can  be  combined 
with  cassette  technology  to  provide  the  efficiency  of  a  mass  commxini- 
cation  technique •    And  of  great  importance  is  that  v/ith  CSCS,  the 
client  does  not  have  to  be  a  prisoner  of  someone  else's  time 
schedule. 
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National  Education  Association 


When  I  told  a  colleague  that  I  was  going  to  Indiana  to  speak  about  cor- 
rectional education,  he  said,  "What  do  you  know  about  th-  special  education 
of  children?" 

I  saidi  "What  do  you  mean?" 

"Didn't  you  say  corrective  education?" 

"No,  no.    Not  the  physically  handicapped.    This  is  correctional  edacation.. 
Prisons ." 

I  wonder  if  it  was  just  a  mis-hearing  or  whether  many  people  think  of 
correctional  education  in  the  same  way. 

Crime  marches  on  in  American.    Adult  and  juvenile  crime  and  delinquency 
are  on  the  increase.    Perhaps  two  million  children  "come  to  the  attention"  of 
the  police  annually.    Who  knows  how  many  do  not?    A  half  million  cases  are 
handled  by  the  juvenile  courts  each  year.    About  a  million  and  a  half  others 
which  do  come  before  the  police  are  disposed  of  without  penal  proceedings . 
About  one  person  in  every  six  who  is  arrested  is  under  21  years  of  age. 

You  know,  as  professionals,  these  facts,  but  even  the  layman  has  some 
notion  of  the  extent  of  crime  and  delinquency.    After  all,  a  daily  reader  of 
the  morning  paper  can  hardly  help  but  be  aware  of  crime  in  metropolitan  America. 
For  example,  shortly  before  Christmas,  the  Washington  Post  ran  on  one  page 
stories  under  the  following  captions:    "Ex-Convict  Fears  Criminal  Past," 
"District'^curt  to  Settle  FBI  Record  Case."    "Drug  Case  Juror  is  Arrested." 
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"Threat  Halts  Demolition  of  N.        Building."    "Jury  Selected  for  Comeau  Trial 
in  Mattingly  Death."    "High's  Stores  Plagued  in  Rash  of  Robberies  During 
November." 

Aware  of  the  local  problem  of  shoplifting,  businessmen  in  North  Carolina 

attended  seminars  on  "Reducing  Shoplifting  Losses"  and  "Outwitting  Bad  Check 

Passers"  conducted  by  the  local  community  college. 

Educational  programs  in  penal  institutions,  and  specifically  adult  basic 

education  (ABE)  programs  help  to  reduce  recidivism  and  thereby  reduce  crime. 

I  do  not  need  to  review  the  history  of,  or  the  current  status  of  ABE.  That 

you  have  been  doing  as  part  of  your  hour-in  and  day-out  Seminar  for  ten  days. 

You  know,  for  example,  about  the  ABE  demonstration  projects  on: 

Training  to  develop  employability  among  mentally  retarded  inmates  in 
institutions; 

Using  college  students  from  poverty  areas  as  teachers  of  adult  basic 
education  to  teach  illiterate  residents  of  mountain  areas  in  Appalachia; 

Recruiting  and  instructing  of  paraprofessionals  to  assist  a  Negro 
inner-cit^  community  to  raise  its  educational  level; 

Producing  a  film  and  series  of  instructional  guides  for  teacher- 
training  in  ghetto  areas; 

Measuring  effects  of  adult  basic  and  social  education  programs  on 
post-release  adjustment  and  educational  achievement  of  inmates  of 
correctional  institutions. 

However,  let  me  sketch  a  profile  of  the  typical  ABE  person— nationally-- 
so  that  you  can  compare  your  own  ABE  students  with  him:     (Cortright,  1970.) 
(See  also  Attwood,  1970.) 

White  (56.6  per  cent),  female  (56.1  per  cent),  with  a  family  income 
under  $3,000  per  year  (44.5  per  cent),  employed  (55  per  cent),  be- 
tween 24  and  4^  years  of  age  (46.5  per  cent).    Grade  levels  between 
first  to  third  grade  classes  (26.7  per  cent),  fourth  to  sixth  grade 
classes  (33.6  per  cent),  and  seventh  or  eighth  grade  classes  (39.7 
per  cent) .     (p.  63) . 

This  profile  suggests  that  the  problem  of  illiteracy  in  the  United  States 
O  will  remain  a  major  socio-economic  problem  for  years  to  come — perhaps  decades. 

ERIC 
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You  know  that  illiteracy  results  in  reduced  national  wealth,  social  and 
cultural  lags,  weakened  national  security,  slowed  technological  progress, 
hastened  displacement  of  workers,  lowered  production,  slowed  economic  growth, 
vjeakened  democracy,  and  retarded  world  understanding  and  cooperation.  Many 
Americans,  however,  still  do  not  realize  that  millions  of  other  Americans 
cannot  read  a  daily  newspaper,  a  weekly  magazine,  the  Bible,  or  a  paperback 
nove.    These  are  the  adults  who  for  one  of  several  reasons  are  the  adult 
functional  illiterates  in  the  United  States. 

The  adult  functional  illiterate  is  a  "social  isolate";  he  is  cut  off 
from  the  mainstream  of  society.     Illiteracy  itself  is  a  "social  deficit." 
The  illiterate  bypasses  the  age  of  the  printed  page  as  he  moves  into  the  age 
of  the  mass  media.    He  is  like  the  illiterate  Asian  or  African  who,  in  the 
twentieth  century,  is  beginning  to  learn  about  jets  or  missiles  while  his 
nation  is  actually  still  in  the  sixteenth  century. 

Many  inmates  are  adult  functional  illiterates.    In  federal  prisons, 
about  eleven  per  cent  of  the  nearly  21,000  inmates  are  considered  illiterate 
(below  grade  6.0).    On  a  given  day  about  1,500  inmates  are  attending  classes. 
Another  1,500  inmates  are  attending  high  school  classes,  and  about  1,000  are 
attending  GED  preparatory  classes.     (See  Carpenter,  1971).    One  correctional 
educator  recently  told  me,  however,  that  only  three  per  cent  of  all  inmates 
may  be  taking  part  in  educational  programs  in  penal  institutions. 

The  public  schools  are  trying  out  a  variety  of  programs  to  bring  back 
school  dropouts,  those  under-educated  young  adults  from  whom  an  overly  large 
number  of  lawbreakers  come.    For  example,  in  Las  Vegas,  (Nevada)  Valley  High 
School  (now  called  Urban  High)  has  been  designed  to  meet  the  specific  needs 
of  the  students  of  that  unique  community,  catering  to  the  dropouts,  chronic 
truants,  erstwhile  lawbreakers,  and  bright  ordinary  kids  desenchanted  with 


c 
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day  school.    Reports  from  Las  Vegas  indicate  that  students  who  hold  down  full- 
time  jobs  in  the  show  and  gambling  businesses  are  succeeding  at  Urban  High. 
Why  not  utilize  the  school  facilities  this  way,  cut  down  costs,  and  use  this 
evidcuce  to  sell  the  public  on  voting  bond  issues?    And,  since  dropouts  are 
sometimes  prone  to  commit  crimes,  thereby  cut  down  on  crime? 

Two  incidents  come  to  mind  when  I  think  about  correctional  education,  both 
from  Asia.    A  f€:w  years  ago  I  was  working  in  the  Philippines  and  went  to  a 
prison  in  the  Manila  area  to  test  some  new  adult  basic  education  materials 
in  the  Tagalog  and  Ilocano  languages.    The  warden  was  friendly  and  took  our 
group  on  a  tour.    As  we  climbed  the  stairs  in  one  block  I  read  a  series  of 
signs,  carefully  hand-printed  and  attached  in  ascending  order:     "Be  Quiet-- 
Don't  Smoke — Keep  Clean--Don't  Steal."    That  was  learning  to  read  by  the 
looksay  method.    The  warden  did  not  comment:  on  its  effectiveness. 

Another  incident  took  place  in  Pakistan,    I  was  involved  in  a  teacher 
training  program  and  wanted  to  involve  teachers  from  the  provincial  prison. 
So  off  to  the  warden— and  this  time  he  took  us  on  a  tour,  gradually  leading 
us  to  what  he  felt  was  the  most  important  part  of  the  prison.    The  cells,  the 
furniture,  the  fresh  air,  the  books,  and  the  execution  chamber.    He  was  very 
proud  of  the  scaffold  and  insisted  that  the  punishment  was  dispatched  with  alacrity. 

These  incidents  come  back  to  mind  whenever  I  think  about  correctional 
education.    I  suppose  the  first  one  was  an  example  of  poor  pedagogy,  but  at 
least  it  was  an  attempt  to  use  written  communication  to  communicate.    And  the 
second,  well,  that  was  correctional  education  in  which  the  correction  was  made 
permanent:    like  the  correction  fluid  which  typists  use  to  correct  (obliterate) 
a  mistake.    Is  that  what  many  people  still  believe  "correctional  education"  to 
be? 
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To  most  laymen  the  problem  of  correctional  education  is  probably  simple. 
Either: 

(1)  Correct  (obliterate)  the  inmate; 

(2)  Correct  (keep  him  where  he  is--physically  and  mentally); 

(3)  Correct  (show  him  his  mistake  and  help  him  to  *:ectify  it). 

I  should  suppose  that  most  of  us  accept  point  three--and  we  include  ABE  as 
one  way  to  help  the  inmate,  and  thereby  society.    ABE,  federally  funded,  has 
been  with  us  long  enough  to  have  accumulated  a  series  of  myths.     Let's  dispense 
with  some  of  the  myths  about  ABE.     I  would  say  these  are  some  which  are  still 
promulgated : 

1.  ABE  teachers  are  not  usually  very  good.    After  all,  they  are 
just  (slightly)  warmed-over  teachers  of  children  who  want  to 
moonlight  for  a  few  extra  bucks.     (See  Cortright,  1970,  for 
a  broader  picture). 

2.  ABE  teachers  have  few  instructional  materials  which  can  be  used. 
What  we  need  to  do  is  get  the  publishers  finally  to  produce 
some  useful  materials  for  adults.     (See  Adult  Basic  Reading 
Instruction  in  the  United  States,  1967,  for  a  different  viewpoint). 

3.  If  only  there  was  some  effective  training  for  ABE  teachers,  they 
would  be  prepared  to  do  a  good  job.    Why  don't  the  universities 
set  up  short  courses  and  degree  programs?     (See  Luke,  1970,  for 
a  counter  statement) . 

4.  Adult  education  is  the  forgotten  part  of  education.    Nobody  knows 
there  even  is  such  a  program.     (See  DeCrow,  1968,  for  another 
point  of  view) . 

We  know  there  are  good  ABE  teachers,  although  some  are  poor.    We  know 
there  are  many  useful  ABE  materials.    We  know  there  have  been  effective 
training  programs.    We  know  the  status  of  ABE  has  improved.    We  know  these 
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myths  about  ABE  in  the  public  r.chools  are  false.    But,  are  these  myths  false, 
also,  in  the  penal  institutions?    What  is  the  purpose  of  ABE  programs  in 
correctional  institutions?    To  help  equip  the  inmate  to  function  in  society? 
Correctional  personnel  then  also  have  the  responsibility  to  help  make  society 
understand  the  inmate  as  a  member  of  soceity.    A  warden  writes,  "Education 
is  one  of  the  most  effective  tools  within    a  prison  in  the  rehabilitation 
or  treatment  program."    (Vitek,  1967).    A  number  of  indications  from  Maryland, 
Ohio,  and  Wisconsin  point  up  the  fact  that  with  more  education,  there  is  less 
recidivism..  (Cortright,.  1965).    Inmates  can  learn  to  read,  reading  advances 
education,  and  education  leads  away  from  redicivism.    Does  the  syllogism 
need  to  be  clearer? 

Assuming  that  we  are  gathered  here  after  nearly  a  fortnight  of  forceful 
presentations  and  hurried  and  harried  hours  of  work  in  the  spirit  of  the 
third  alternative  (see  above),  I  would  like  to 

make  a  few  suggested  approaches  for  your  decision — making  consideration 

as  you  plan  to  implement  your  personal  management  plan--back  home.  These 

are  the  points  which  I  think  need  special  attention  in  using  a  systems  approach 

to  organize  for  more  effective  ABE  programs  in  correctional  institutions. 

1 .      Develop  innovative  programs  which  make  a  difference 

Excuse  the  new  expression,  "innovative**.    But  isn't  that  really  the 
purpose  of  this  regional  Seminar? 

Learning  Systems,  Inc.  has  developed  a  concept  of  technical  clusters 
for  inmates  in  West  Virginia  and  Pennsylvania.    The  concept  focuses  on  an 
area  of  industrial  arts,  such  as  printing,  and  brings  the  teachers  together 
as  a  team  to  teach  this  topic  in  a  1200  hour  mini-project.    For  example,  one 
mini-project  was  the  production  of  a  booklet  on  the  great  religions  of  the 
world.    Five  different  teachers,  including  communication  and  math  teachers, 
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each  spent  time  helping  inmates  learn  what  they  needed  to  know  in  order  to 
produce  the  booklet.    The  important  part,  I  think,  was  the  motivation  which 
was  generated.    There  was  a  need  by  inmates  to  learn  to  write  a  sentence, 
count  how  many  copies  of  booklets  might  be  sold,  and  find  out  about  job 
opportunities  which  might  be  available  at  the  time  of  release  so  that  they 
woiild  have  a  handle  on  a  tangible  occupation. 

Another  means  of  motivation  (Mauk,  1970)  was  to  use  a  financial  incentive. 
If  a  person  has  completed  elementary  school,  his  expected  lifetime 
income  is  $277,000.     If  he  completes  high  school  he  is  likely  to  add  $94,000, 
bringing  his  lifetime  income  up  to  $371,000.    Four  years  of  college  should 
add  another  $213,000,  bringing  income  to  $584,000. 

What  innovations  have  been  successfully  used  to  motivate  inmates  to 
complete  an  ABE  program?    Most  wardens  with  any  tenure  at  all  have  their  fav- 
orite stories  about  Inmate  Y  and  Inmate  Z  who  was  released,  became  successful 
in  readjusting  to  the  outside  world,  and  sent  back  a  Christmas  card.    He  made 
it.    Surely  that  evidence,  although  sparse,  is  welcome.    However,  what  happened 
to  all  of  the  other  released  inmates?    To  what  extent  did  the  educational 
experiences  in  prison  help  them?    In  other  words,  what  research  facts  do  we 
have?    I  would  suggest,  as  part  of  the  delivery  system  which  you  are  developing 
here  and  in  the  other  Regional  Seminars,  a  careful  examination  of  this  question. 
This  research  might  begin  with  the  recidivists.    Did  the  ABE  program  which 
Inmate  X  received  help  him?    Evidently  not,  since  he  returned.    But  why  not? 
If  we  do  not  measure,  in  some  way,  our  programs,  how  can  we  know  if  we  have 
been  effective?    Correctional  education  goes  on  all  the  time  in  prisons  and 
penitentiaries  and  jails.    The  point  is  not  that  there  is  no  education  in 
Prison  P;  the  problem  is  that  there  may  be  too  much  education--of  the  wrong 
kind . 
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2*      Match  teacher  end  learner — for  comp'atabi lity 

After  all,  no  one  gets  along  with  everyone.    A  study  from  Ontario 
indicates  that  scores  on  hidden  figure  tests  are  useful  in  determining  student 
readiness  for  group  or  individual  study,  as  well  as  the  suitability  of  certain 
teachers  to  act  as  leaders  or  consultants  with  certain  students.    An  example 
of  an  attempt  at  better  matching  is  the  cooperative  training  project  jointly 
sponsored  by  the  University  of  Georgia,  Teacher  Corps,  Georgia  Department 
of  Corrections,  and  the  Goergia  Department  of  Education* 

Ahlstrom  and  Havighurst  (1971)  suggest  guidelines  for  preventing  dropouts, 
those  students  who  provide  the  potential  inmate  population. 

1.  Maladjusted  students  need  teachers  with  endless  patience  and 
determination  to  help  them  make  an  adjustment. 

2.  Those  students  who  do  profit  from  the  work  experience  owe  as 
much  to  the  inter-personal  relationships  as  to  the  owrk  skills 
learned . 

3.  Preventive  counseling  can  help  students  before  trouble  occurs. 
Presently,  a  counselor  is  brought  in  only  after  the  damage  has 
been  done;  and  after  the  immediate  trouble  is  past,  the  case 
is  dropped. 

3.      Use  volunteer  aides 

The  Psychological  Services  Center  of  the  Lorton  (Virginia)  Prison  uses 

volunteer  tutors  to  help  illiterate  inmates.    The  National  Affiliation  for 

Literary  Advance,  an  organization  of  volunteer  literacy  councils  has  helped 

organize  volunteer  work  In  Sing  Sing  Prison,  Georgia  State  Prison  (Reidsville) , 

New  Jersey  State  Prison  (Rahway) ,  Jefferson  Parrish  Prison  (Louisiana), 

Illinois  State  Penitentiary  (Joliet),  and  the  San  Antonio  County  Jail  (Texas). 

I  have  seen  volunteer  tutors  working  with  inmates  in  Walla  Walla  (Washington) 

and  Auburn  (New  York).    Under  direction,  the  volunteer  can  help  the  professional 

teacher.    The  fact  that  the  President's  National  Reading  Council  plans  to 

enlist  hundreds  of  thousands  of  volunteer  tutors  attests  to  the  soundness  of 

using  volunteers. 
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4.      Relate  ABE  with  AHE 

Recent  legislation  has  supported  adult  education  to  the  twelfth  grade 
level  for  adults.    When  this  legislation  is  funded,  chere  is  going  to  be  a 
large  increase  in  Adult  High  School  Education  (AHE)  programs.    Of  course, 
AHE  is  not  new  to  inmate  education.    The  Bureau  of  Prisons  estimates  over 
1,000  GED  diplomas  issued  annually.    But  we  need  to  move  more  men  and 
women  inmates  to  the  high  school  level.    In  fact,  after  discussion  with 
labor  and  manpower  economists,  I  am  doubly  troubled  about  just  how  far  the 
eighth  grade  level  gets  a  person  anyway — particularly  in  terms  of  job  placement. 
The  point  now  is  to  inter-relate  ABE  and  AHE  so  that  the  ABE  student  is  motivated 
to  go  the  second  mile — and  get  his  diploma.    This  is  another  reason  for  a 
close  articulation  of  inmate  education  with  the  public  schools. 

Make  contact  with  your  local  director  of  adult  education.    Find  out  how 
he  can  help  you.    The  local  education  association  may,  throuth  its  adult 
education  committee,  find  a  teacher  or  two  who  can  counsel  and/or  provide 
a  few  volunteer  teaching  hours.    Or,  can  you  pry  more  funds  to  hire  another 
adult  education  teacher  on  your  staff? 

5 •      Let  the  correctional  educators  say,  "We,  too,  will  be  accountable." 

Good  teachers  want  everyone  to  know  that  they  are  doing  a  good  job  and 
deserve  a  good  salary  with  appropriate  benefits.    They  want  to  provide  educa- 
tional experiences  for  inmates:    quality  education.    Teachers  can  be  accountable. 
The  goal  is  to  establish  a  (correctional)  education  profession  which  determines, 
abides  by,  and  enforces  its  own  standards.    The  following  contingencies  for 
teacher  accountability  are  adapted  from  the  National  Commission  of  Teacher 
Education  Professional  Standards  (1970): 

1.    Clear  goals  for  correctional  education,  based  on  both  local  values 
and  priorities  and  national  purposes. 
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2.  Acceptance  of  expert  judgement  of  appropriate  teaching  and  learning 
to  achieve  such  goals, 

3.  An  adequate  number  of  personnel  with  sufficient  skills  to  perform 
so  that  accepted  goals  are  achieved, 

4.  Provision  for  identifying,  educating,  retaining,  and  continuously 
re-educating  teachers  to  assume  that  they  will  always  be  up  to  date, 

5.  Teaching  loads,  time,  and  support  services  which  are  conducive  to 
quality  performance. 

6.  Appropriate  media,  materials,  facilities,  and  learning  resources, 

7.  Satisfactory  salaries  and  welfare  programs  for  teaching  personnel. 

8.  High  morale  on  the  part  of  those  who  teach. 

9.  Appropriate  evaluation  of  all  the  goals  of  instruction--academic, 
attitudinal,  humanistic  and  behavioral--taking  to  account  that  the 
educational  process  itself  should  be  highly  valued  and  judged  along 
with  learning  outcomes. 

10.  Leadership  in  institutions  that  fosters  a  wholesome  social-psychological 
setting,  an  openness  to  constructive  change,  and  a  climate  conducive 

to  teacher  and  student  success, 

11.  Strong  public  committment  ot  correctional  education  expressed  in  both 
moral  and  finanical  support, 

12.  Provision  by  top  administrators  and  boards  of  education  of  material 
resources,  psychological  climate,  and  the  freedom  needed  to  ensure 
top  performance  by  both  teachers  and  strdents.     (pp.  1-2) • 

Of  course,  the  profession  has  not  achieved  this  level  of  performance  yet. 

But  this  is  the  goal  of  those  teachers  whose  correctional  administrations  should 

encourage  to  stay  in  the  field.    There  may  not  be  enough  dropouts  amont  the  poor 

teachers . 

Donald  Wilson,  President  of  the  Association  of  Classroom  Teachers  asks 
these  questions: 

How  should  teachers  respond  to  the  issue  of  accountability?    Do  we 
assume  a  posture  of  apologetic  def ensiveness ,  or  do  we  talk  about 
accountability  from  a  position  of  strength?    Do  we  reject  completely 
what  the  ciritcs  say,  or  do  we  refine  their  statements  and  say  clearly 
where  we  classroom  teachers  believe  the  major  responsibility  lies  for 
innovations  in  education  and  for  the  task  of  defining  the  learning 
proci^ss  and  how  it  happens? 
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We  must  consider  the  relationship  between  authority  and  accountability. 
We  must  determine  whether  we  can  delineate  a  sphere  of  accountability 
for  the  classroom  teacher  for  his  own  performance  and  for  that  of  his 
students 

It  is  proper  and  right  for  effective  teachers  in  prisons,  like  all 
effective  teachers,  to  monitor  their  own  teaching;  that  is,  to  provide 
governance  for  their  prof^^sion.    Part  of  this  governance  includes  the  right 
of  the  teachers  to  help  regulate  the  kind  of  educational  experiences  in 
universities  and  to  help  'aetermine  the  university  curriculum  for  advocating 
correctional  education.    Educational  associations  might  want  to  work  with 
correctional  educators  in  designing  appropriate  curriculum  for  teachers  of 
adult  basic  education. 

6.      Improve  the  status  of  correctional  educators 

Sufficient  funding  is  imperative.    A  colleague  from  Quebec  has  suggested 

that  funds  appropriated  for  regular  day  schools  be  decreased  and  then 

these  added  monies  be  included  in  a  larger  fund  which  is  available  to  adults 

at  age  twenty  or  latter  who  are  ready  for  school  and  know  what  they  want  ot 

learn  from  school*    Some  of  these  funds  could  go  for  proven  correctional 

education  projccus.    The  Secretary-Treasurer  of  the  Correctional  Education 

Association  surveyed  a  group  of  correctional  educators  (the  767  members  of 

the  Correctional  Education  Association  represent  perhaps  five  per  cent  of  the 

potential  population  of  correctional  educators).    He  found,  for  example,  that 

South  Dakota  has  an  accredited  school  with  inmate  instructors  and  that  Texas 

has  established  a  school  district  within  a  correctional  system.     (Seidler,  1971). 

Correctional  educators  are  concerned  about  the  work  they  do.  The 
teacher  in  the  classroom  has  little  or  no  time  to  write  about  what  be 
is  doing.    He  is  too  busy  trying  to  deal  with  the  failuies  of  public 
school  education.    He  is  bothered  by  the  failures  represented  by  high 
rates  of  recidivism.    Usually  he  is  the  primary  socializing  force 
within  the  institution.    If  he  does  his  work  well,  custodial  supervision 
is  easier. 

ERIC 
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The  inmate  finds  a  larger  sense  of  worth  because  he  becomes  a  person 
within  the  classroom.    When  things  go  wrong  within  the  institution 
the  education  and  vocational  programs  are  the  first  ones  shut  down. 
He  is  likely  to  find  his  curriculum  and  his  spending  determined  by 
administrative  order.    He  is  not  recognized  as  a  professional  in  the 
institution  nor  is  he  recognized  as  one  in  the  community.  Whatever 
we  can  do  together  will  of  necessity  have  to  say  something  about  the 
professional  status  of  correctional  teachers  (p.  5) 

Should  not  teachers  of  ABE  in  correctional  institutions  join  teacher 

associations  and  therefore  be  included  in  the  bargaining  units  of  teacher 

associations?    The  following  suggested  provisions  for  contracts,  adapted  from 

the  National  Education  Association  may  be  helpful  for  correctional  educators 


in  preparing  appropriate  provisions. 

1.  Full  and  part-time  teachers  of  inmates  should  have,  to  the  extent 
possible,  the  same  contractual  benefits,  rights  and  privileges, 
including  access  to  the  grievance  procedures,  as  any  other  teacher 
in  the  association. 

2.  The  hourly  rate  of  pay  for  part-time  teachers  of  inmates  should 
be  computed  according  to  some  objective  and  equitable  basis,  such 
as  an  hourly  rate  based  upon  the  salary  of  a  full-time  teacher  of 
children  with  comparable  training  and  experience. 

3.  Full-time  and  part-time  teachers  of  inmates  who  work  outside 
"regular  school  hours"  should  receive  such  additional  benefits  and 
protections  as  are  necessary. 

4.  Provision  for  at  least  ten  hours  of  in-service  training  programs 
in  methods  of  teaching  adults  shall  be  made  by  the  institution 
at  no  cost  to  teachers  in  which  they  shall  participate  at  their 
regular  rate  of  pay. 

5.  Provision  should  be  made  for  teachers  to  attend,  at  institution 
expense,  at  least  one  professional  education  conference  during 
the  school  year. 

7 ,      Employ  correctional  educators  in  the  public  schools 

The  process  should  go  both  ways.    Crime  prevention  as  communicated  in 

adult  education  courses  in  the  public  schools  is  one  way  of  communication  to 

parents  of  school  age  children.    Already  some  adult  education  departments  in 

the  public  schools  are  operating  such  courses.    Correctional  educatior  would 

be  ideal  resource  specialists  or  course  leaders.    Olson  (1971)  reports  a 
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course  on  "Parents  Concerns  in  Drug  and  Sex  Education"  offered  by  the  Prince 
George's  County  (Maryland)  Public  Schools.    Public  schools  also  offer  courses 
for  inmates.    "Crime  and  Delinquency  Prevention  Program"  is  offered  in  the 
Flint  (Michigan)  adult  education  program.    This  course  includes  aptitude 
testing,  public  speaking,  vocational  counseling,  job  placement  assistance, 
and  various  follow-through  services  for  inmates.    Eighty  per  cent  of  those 
taking  the  program  have  not  been  re-arrested  in  a  twq  year  period.    The  Fort 
Wayne  (Indiana)  Consnunlty  Schools  offer  programs  leading  to  the  ^ED.  Graduates 
with  the  diploma,  but  not  released  from  jail,  become  teachers'  aides. 

Could  correctional  educators  be  trained  to  serve  as  consultants  to,  or 
leaders  of  adult  education  programs  in  the  public  schools?    Could  they  carry 
out  home  visits  and  help  ease  the  "rs-entry"  problem  of  inmates?    Crime  itself 
hurts  adult  education.    The  headline  of  the  Washington  Dai^y  News  of  January  7 
was  "Crime  Forces  Big  Drop  in  D*  C.  Night  Schools."    People  were  afraid  to 
come  out  at  night  to  go  to  night  classes  for  adults. 
8.      Consider  resigninfi  from  correctional  education 

I. have  not  seen  your  flow  charts  and  have  not  followed  your  loops.    But  I 
might  guess  that  one  direction  which  some  correctional  leaders  might  go — is  right 
off  the  page.    That  is,  teaching  or  administering  an  ABE  program  in  a  correctionol 
institution  is  not  for  him  or  for  his  colleagues'.     In  that  case,  perhaps  he 
should  consider  resigning.     I  ha^'    on  my  desk  the  announcement  of  a  new  job 
to  coordinate  a  broad  range  of  residential  conferences,  institutes,  seminars, 
workshops,  and  short  courses  for  managerial  and  supervisory  personnel.  The 
person  helding  the  position  should  have  a  correctional  background,    is  that  for 
you?    Or,  is  one  of,  I  am  sure,  many  c      ^  related  jobs?    If  you  leave,  however, 
find  someone  to  take  your  place  and  tr^      ^.t  to  him  or  her  your  conceptual 
model  and  management  scheme.    Let's  keep  only  the  best  and  most  dedicated 
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professionals  in  correctional  education,  monitor  the  profession  ourselves. 
After  all,  correctional  work  is  not  for  everyone.     But,  for  those  who  stay, 
let  tliem  really  believe  it  can  make  a  difference. 

My  position  in  the  futurology  of  correctional  ABE  is  that  if  some  of 
the  eight  suggestions  mentioned  today  are  implemented--tlie  future  of 
correctional  education  will  be  bright.     Since  most  of  the  thousands  of  adult 
inmates  do  return  to  the  larger  society  from  whence  Lliey  came,  then  the  need 
for  education,  and  specifically  that  of  adult  basic  education,  is  imperative.      ,  * 
Without  an  elementary  adult  education,  let  alone  a  liigli  scliool  education, 
the  economic  prospects  for  an  ex-inmate  are  bleak.    Witliout  a  job,  tlie 
chances  of  recidivism  are  gorss.    Recidivism  repeats  the  cycle,  and  education, 
cnce  agaiii,  and  this  time  correctional  education,  has  failed. 

We  need  all  of  the  useful  manpower  our  nation  can  provide  for  tlie  exciting 
decade  ahead,   tliat  what  the  United  Nations  calls  the  Second  Development  Decade. 
Surely  we  know  now  that  inmates  can  sometimes  be  rehabilitated  and  that  effec- 
tive education  is  a  necessary,  if  not  sufficient  cause  for  the  reliabi litation. 

Perhaps  the  tail  will  wag  the  dog.     In  the  public  schools,  teachers  are 
assuming  greater  leadership  responsibilities.     Teachers  may  run  schools:  Analogou 
will  that  happen  In  the  penal  institutions?    If  education  leads  to  rehabilitation, 
then  perhaps  the  tail  will  wag  the  dog  in  institutions  also. 

This  futurologist  concludes  by  pleading  for  a  better  system  of  correctional 
education  in  our  land--to  help  redeem--in  effect,   the  entire  field  of  corrections* 
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Based  upon  a  dissertation  "The  Newsletter  as  a  Communication  Medium  in 
Teaching  Low-Income  Homemakers"  by  Joseph  A,  B.  Efionayi  at  The  Ohio  St 
University  in  1970. 


Educational  researchers  strive  to  do  the  best  possible  research  to  solve 
the  problem  under  study.    In  many  cases  this  means  the  use  of  experimental 
or  qua si -experimental  designs  such  as  those  discussed  by  Campbell  and 
Stanley  (2,  pp.  171-246),    The  research  being  reported  in  this  paper  is  one 
example  of  the  use  of  the  posttest-only  control  group  design  as  explained 
by  Campbell  and  Stanley,    In  reviewing  the  analysis  of  this  design  by 
Campbell  and  Stanley  one  notes  this  design  has  little  internal  invalidity 
and  has  as  good  external  validity  as  any  of  the  true  experimental  designs. 

The  primary  purpose  of  the  study  was  to  determine  the  ef fectivsness  of 
newletters  as  a  medium  of  information  for  a  program  designed  to  improve  the 
the  quality  of  nutrition  among  the  low- income  families. 

The  objectives  were  to  determine  the  sources  from  which  the  low- income 
families  generally  receive  information  about  nutrition,  to  determine  the 
extent  to  which  the  participants  acquired  knowledge  of  nutrition  principles 
as  taught  through  newsletters  and  to  determine  the  participants*  attitude 
towards  newsletters  as  a  medium  of  information  about  nutrition. 

As  can  be  observed  by  an  analysis  of  the  objectives,  only  the  second 
and  third  objectives  were  related  to  the  experimental  part  of  this  study. 
For  this  reason,  discussion  on  methodology  is  related  primarily  to  these 
two  objectives,  although,  some  findings  are  related  which  deal  with  the 
first  objective. 

Nature  of  the  Study 
This  study  was  carried  out  in  connection  with  the  Expanded  Food  and 
Nutrition  Education  Program  (EFNEP)  as  conducted  by  the  Ohio  Cooperative 
Extension  Service,    The  EFNEP  program  was  designed  to  help  low-income 


families  to  more  easily  solve  their  nutrition  problems  -  to  efficiently  use 
their  food  dollars  and  effectively  provide  for  adequate  nutrition  of  their, 
family  members. 

The  EFNEP  program  was  initiated  to  reach  the  low-income  families  by 
personal  contact.    This  was  done  by  paraprof essionals  or  aides  who  were 
hired  from  the  low-income  community.     In  most  educational  programs  it  has 
been  shown  that  more  than  one  method  or  communication  medium  was  desirable 
in  educating  clientele.    A  number  of  studies  have  shown  the  newsletter  to 
be  an  effective  tool  in  marketing,  disease  prevention,  home  economics  sub- 
jects, and  related  fields  (1,  pp.  35-53).    For  this  reason  the  newsletter 
was  chosen  as  a  medium  for  study  to  determine  if  it  would  effectively 
supplement  the  personal  contact  of  the  nutrition  aide. 

Methodology 

The  design  of  this  study  was  the  posttest-only  control  group  desit^n 
shown  schematically. 

R  X  0^ 

R 

The  R  represents  randomization,  X  is  the  treatment  given  to  the 
experimental  group,  and  0^  is  the  observations  made  of  the  experimental 
group  while  O2  is  the  observation  of  the  control  group. 

Population 

The  study  was  conducted  in  the  Montgomery  County,  Ohio  area  (Dayton) 
where  there  were  355  families  in  the  Expanded  Food  and  Nutrition  Education 
Program.    These  families  were  being  educated  by  personal  contact  by  15 
nutrition  aides. 
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Pre-determined  income  and  education  levels  were  defined  to  provide 
directions  for  stratification  and  categorization  of  the  participants.  Three 
levels  of  income  were  isolated  and  defined  as; 

(a^    "Lower"  low-Income  group,  $1,999  and  below,  annual  Income. 

(b)  "Medium"  low-income  group,  $2,000  to  $3,999,  annual  income, 

(c)  "Higher"  low-income  group,  $A,000  to  $5,000,  annual  income. 
Each  level  of  income  was  sub-categorized  into  two  levels  of  education, 

(a)  High  Education  (ninth  grade  and  above) 

(b)  Low  Education  (eighth  grade  and  below) 

Sampling  and  Randomization 

In  each  of  the  six  categories  of  the  population  there  was  drawn, 
randomly,  28  families  into  each  of  the  cells: 

"High"  Education         "Low"  Education 
9^^  and  above   8^^  and  below 


Lower  income 

28 

28 

$1,999 

Medium  Income 

28 

28 

$2,000-3,999 

High  income 

28 

28 

$A, 000-5, 000 

Variables 

The  independent  variables  in  this  study  were: 

(1)  A  home  economics  newsletter  on  better  breakfasts 

(2)  Income  levels  of  participants 

(3)  Education  levels  of  participants 

The  dependent  variables  in  this  study  were; 

(1)  The  cognitive  knowledge  scores  on  a  test  on  the  principles  of 
better  breakfasts 

(2)  Participants'  reactions  to  attitudinal  statements  in  relation  to 
the  newsletters 


Treatment 

The  treatment,  a  home  economics  newsletter  on  better  breakfasts,  was 
mailed  every  14  days  starting  in  January,  1970.    Eight  such  newsletters 
were  issued  in  a  series  dealing  with  the  principle  of  buying,  preparation 
and  storage  of  food  in  relation  to  breakfasts. 

The  newsletters  were .written  by  Iris  Macumber,  the  professional  Exten- 
sion home  economist  in  Montgomery  County,  Ohio.    They  were  written  in  simple 
language  with  an  ample  supply  of  pictures  so  they  would  be  suitable  for 
those  with  a  lower  level  of  education. 

The  Dale-Chall  Reading  Difficulty  Formula  (21,  pp.  65-69)  was  used  to 
determine  the  educational  level  at  which  they  were  written.    They  were 
written  at  the  fifth  or  sixth  grade  level. 

All  355  families  in  the  program  were  contacted  by  nutrition  aides  as 
if  no  experimental  work  was  being  conducted.    The  aides  who  visited  the 
families  at  home  knew  the  project  was  In  process  but  did  not  know  who  was 
receiving  the  newsletter  unless  they  saw  It  in  the  home.    No  instruction 
was  given  on  better  breakfasts  by  the  aides  during  the  period  of  the 
experiment. 

Instrument  Development 

An  interview  schedule  was  developed  to  measure  recall  of  nutrition 
principles  on  breakfasts  t.hat  was  taught  In  the  newsletters. 

After  development  of  the  initial  44  items,  the  face  validity  was  checked 
by  having  nutrition  and  testing  experts  study  the  newsletters  and  the  proposed 
questions.    Sources  of  information  about  nutrition  and  better  breakfasts  was 
included  in  the  interview  schedule  as  was  personal  data. 


A  second  segment  of  the  interview  schedule  was  developed  to  determine 
attitudes  about  the  newsletter  by  those  in  the  experimental  group. 

A  field  test  of  the  interview  schedule  conducted  with  the  homemakers 
of  18  families  not  included  in  the  control  or  experimental  groups.  A 
Spearman-Brown  split  half  reliability  check  showed  a  .71  correlation  on  the 
knowledge  test. 

An  item  analysis  was  done  on  the  knowledge  questions  comparing  responses 
of  high  scoring  with  low  scoring  respondents  on  each  question.  Invalid  items 
were  eliminated  leaving  30  items.  ^ 

Interviewers 

The  nutrition  aiaes  were  selected  as  the  interviewers  since  they  had 
rapport  with  the  families.    Aides  were  trained  to  do  interviewing  including 
practice  session  and  field  testing  practice. 

Data  Collection 

Much  of  the  needed  background  data  were  taken  from  permanent  records  on 
the  families  available  In  the  Extension  office.    These  data  were  secured 
by  the  researcher. 

The  remainder  of  the  data  were  collected  from  the  homemakers  of  the 
families  in  the  control  or  experimental  groups  after  conclusion  of  the 
treatment. 

Data  from  files  was  available  on  167  while  data  on  nutrition  knowledge 
was  available  on  120  (there  was  a  72  percent  completion  of  the  interviews). 

Results 

The  findings  of  this  research  study  as  they  relate  to  the  specific 
objectives  are  presented  here. 


Specific  "Objective  1  To  determine  those  existing 

sources  of  information  through  which  the  low-income 
families  generally  receive  their  nutrition  information. 

The  respondents,  both  the  control  and  the  experimental  groups,  perceived 
the  nutrition  aides  as  their  most  frequent  sources  of  nutrition  information. 
Television  was  ranked  second  by  both  groups  and  frequency  of  contact  with 
neighbors  was  ranked  eighth  by  both  groups.    The  frequencies  of  exposure  to 
all  sources  of  information  on  nutrition  was  significantly  correlated  between 
the  control  and  the  experimental  groups. 

To  the  question  regarding  sources  of  information  on  better  breakfasts, 
the  nutrition  aides  were  ranked  as  the  most  frequent  source  of  information 
about  better  breakfasts.    The  experimental  group  ranked  the  newsletter 
second;  the  control  group  ranked  the  newsletter  eleventh. 

Both  groups  perceived  the  store  owners  as  least  frequent  sources  of 

information  on  better  breakfasts. 

Specific  Objective  2           To  determine  the  effectiveness 

of  the  newsletter  as  a  medium  of  communication,  in 
enhancing  the  cognitive  knowledge  of  homemakers  of 
low-income  families  with  relation  to  nutrition 
principles. 

The  experimental  group  that  read  the  newsletter  had  a  mean  score  of  23.3 
regarding  knowledge  of  nutrition  while  the  control  groups  that  did  not  read 
the  newsletter  had  a  mean  score  of  20.9.    This  was  a  significant  difference. 

When  the  three  income  categories  were  compared  there  was  no  significant 
difference  between  the  cognitive  knowledge  mean  scores  of  the  incomr  groups. 

Within  the  lower  income  group  of  $1,999  and  below,  the  low  education 
homemakers  (eighth  grade  level  of  education  and  below)  learn  more  than  the 
homemakers  with  a  ninth  grade  level  of  education  and  above.    The  lower  educa- 
tion groups  had  a  mean  score  of  21.00  while  the  homemakers  with  an  educational 
level  of  ninth  grade  and  above  had  a  mean  score  of  18.64. 


within  the  groups  categorized  as  medium  and  upper  income  levels,  the 

different  levels  of  education  had  no  great  effect  on  the  homemakers  in 

learning  from  the  newsletter.    Their  meaa  cognitive  knowledge  scores  showed 

no  significant  difference. 

Specific  Objective  3           To  determine  the  direction  and  extent 

of  low-income  families'  attitudes  toward  newsletters  as  a 
medium  of  information  on  nutrition. 

Low- income  homemakers  with  low  education  ranked  highest  among  the 
groups  who  felt  like  doing  what  they  read  in  the  newsletter. 

The  number  of  homemakers  who  did  what  was  read  in  the  newsletter  on 
better  breakfasts  was  larger  among  those  with  lower  income  - than  among  those 
with  higher  income. 

The  number  of  homemakers  who  perceived  lack  of  money  as  cause  for  not 
taking  action  increased  with  a  decrease  in  income  and  increase  in  education. 

The  number  of  homemakers  who  perceived  the  color  of  the  paper  used  for 
the  newsletter  as  being  attractive  increased  with  a  decrease  in  income  but 
with  an  increase  in  education. 

Conclusions 

While  caution  must  be  exercised  in  generalizing  the  result  findings, 
the  following  conclusions  were  reached. 

The  use  of  newsletters  in  the  nutrition  program  had  proven  its  value 
by  providing  directed  experience  for  the  low-income  homemakers  in  Montgomery 
County  and  by  involving  them  at  individual  rate  of  learning  process. 

The  low- income  homemakers  perceived  having  learned  new  ideas  from  the 
newsletter  and  that  it  had  helped  them  in  saving  money  on  buying  of  food. 

The  learning  situation  was  brought  closer  to  the  homemakers  through 
the  newsletters  and  offered  experiences  which  stimulated  self  activities 
on  the  part  of  the  low-income  families. 


The  level  of  formal  education  of  the  low-incoi. ?  homemakers  wa<5  a 
factor  in  the  amount  of  learning  acquired  of  nutrition  principles  through 
the  newsletters. 

Rising  levels  of  income  were  not  related  to  an  increase  in  the 
learning  rate  of  low- income  families  in  Montgomery  County. 

The  formal  education  level  of  the  low-income  families  had  effect  on 
their  attitudes  towards  the  newsletter  as  their  medium  of  education.  The 
higher  the  level  of  education. the  stronger  the  favorable  attitude  .cate- 
ments  were  evidenced. 

The  newsletter  is  a  potential  communication  medium  through  which  the 
low- income  families  could  be  taught  about  nutrition  principles.    The  u?e 
of  newsletter,  therefore,  should  be  incorporated  into  the  teaching  methods 
now  being  adopted  In  Montgomery  County,  Ohio  nutrition  programs. 


J 
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Introduction 

Washington  State  has  had  paraprofessional  Expanded  Food  and  Nutrition 
Education  Program  aides  since  1969  to  encourage  low-income  homemakers  to 
improve  nutritional  intake.    In  that  period  of  timej  from  1969  to  the  present, 
the  state  has  hired  women  on  a  part-time  and  full-time  basis  who  are  from  a 
similar  racial  socio-economic  background  as  their  homemakers.    At  present  there 
are  approximately  100  paraprofessional  EFNEP  aides  employed  in  the  state 
working  with  1500  homemakers.    Program  leaders  and  county  agents  have  evaluated 
the  overall  program  as  successful,  based  on  individual  case  studies  and  data 
collected  showing  improvement  in  homemakers'  nutritional  intake.   The  fact 
that  there  has  been  little  turnover  in  employment  of  aides  also  indicates 
some  satisfaction  with  the  program  on  the  part  of  ^he  aides.   But  determining 
w>»at  makes  the  program  successful,  which  characteristics  an  aide  or  homemaker 
must  have  in  order  to  be  successful,  and  which  characteristics  the  supervising 
personnel  regard  as  important  for  successful  aides  and  homemakers  are  all 
questions  that  have  been  left  unanswered. 

In  rega  i  to  the  aides,  research  seems  to  fit  into  one  of  two  categories: 
(1)   The  study  has  found  no  significant  correlation  between  success  and  other 
characteristics  of  aides;  or  (2)   the  significance  found  between  successful 
eides  anr}  other  aide  characteristics  was  based  on  a  criterion  of  limited  value. 

A  national  study  of  the  Expanded  Food  and  Nutrition  Education  Program  was 
conducted  by  the  Synectics  Corporation  in  1970-71  (29).    Part  of  the  study 
examined  various  characteristics  of  the  program  to  see  if  there  was  a 
correlation  between  specific  characteristics  of  the  aides  and  the  improved 
nutrition  of  the  aides'  homemakers.   The  24-hour  food  recall  taken  when  the 
homemaker  enrolled  in  the  program  and  again  in  six  months  was  the  standard 
criterion  used  to  determine  improvement  of  the  homemaker' s  nutrition. 
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T'lie  researcn  study  found  no  relationship  between  the  characteristics  measured 
(age,  education,  socio-economic  level,  ethnic  background,  and  geographic 
location)  and  improvement  in  the  homemaker's  nutrition. 

A  dissertation  by  Malati  Surendra  Chakravorty  of  Iowa  State  identified 
aide  characteristics  in  terms  of  various  case  studies.    No  objective  measurement 
was  taken  to  determine  these  characteristics,  nor  were  they  measured  against 
any  criteria  to  determine  if  they  do,  as  a  matter  of  fact,  influence  role  or 
job  success  (8). 

Clyde  Triplett  of  Missouri  State  in  1971  was  also  interested  in  aide 
characteristics  and  their  relationship  to  role  performance.   Of  all  the  char- 
acteristics  he  measured,  only  education,  emotional  stability  and  friendliness 
were  found  to  correlate  to  his  established  criterion  of  success.    In  this 
study,  success  of  the  program  aides  was  based  entirely  on  an  evaluation  form 
completed  by  their  supervising  personnel  (36).   Age,  race,  tenure,  residence, 
general  activity,  restraint,  ascendance,  sociability,  objectivity,  friendliness, 
thoughtful ness,  personal  relations,  masculinity-femininity,  trustworthiness, 
altruism,  independence,  strength  of  will,  self-esteen,  and  self-acceptance 
were  tested  variables  that  were  not  found  to  be  significant. 

One  way  of  characterizing  personality  is  in  terms  of  motivation.  The 
concept  of  motivation  might  prove  useful  in  predicting  the  success  of  aides 
and  homemake       As  far  as  could  be  determined,  no  studies  have  been  conducted 
which  look  at  the  aides*  personal  motivation  in  relationship  to  their  work, 
their  recipe  skills,  their  demographic  characteristics  or  their  role  success. 
Questions  of  interest  include  the  following:    (1)    Is  the  aide  who  is  most 
highly  motivated  to  achieve  in  work  the  most  successful  aide?    (2)    Is  the  aide 
who  is  motivated  to  achieve  in  her  work  adept  ut  basic  recipe  skills? 
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In  regard  to  homemakers,  most  studies  available  have  first  of  all  identified 
homemaker  characteristics  such  as  the  mean  age,  education,  family  size,  children 
in  school,  percentages  in  each  ethnic  group,  geographic  location,  and  income 
level  (29,  19,  21,  20,  14).    Second,  each  of  these  studies  has  regarded 
increased  nutritional  intake  of  the  homemaker  in  a  six-month  period  as  shown 
in  the  24-hour  food  recall  as  the  criterion  for  success  as  program  homemakers. 
Two  studies  have  shown  a  relationship  between  the  different  characteristics  and 
homemaker  success  using  this  criterion.    "A  Study  of  The  Expanded  Nutrition 
Program  in  Waco,  Texas,"  has  shown  an  association  between  the  variables  of  age, 
income,  family  size,  and  education  of  homemakers,  and  the  length  of  time  as 
ENP  participants,  with  the  homemakers*  food  and  nutritional  intake  (32). 
In  addition,  a  Louisiana  State  University  evaluation  found  a  relationship 
between  income  of  homemakers  and  improved  nutritional  intake,  and  a  second 
relationship  between  residence  and  progress  in  adopting  all  four_.food  groups  (19). 

Although  homemaker  characteristics  and  homemaker  success  have  been  clearly 
defined,  no  studies  thus  far  examine  the  relationship  between  motivation  of 
homemakers  and  demographic  characteristics,  recipe  skills,  and  success  as 
homemakers  using  the  criterion  of  the  24-hour  food  recall,  and  evaluations 
by  the  program  aide. 

The  limited  information  regarding  the  motivational  make-up  of  program 
aides  and  homemakers  suggests  the  necessity  to  examine  the  aide's  and  home- 
maker's  motivation  and  to  see  how  these  relate  to  their  knowledge  of  recipe 
skills,  their  success  at  changing  nutritional  intake,  and  their  success  at 
performing  institutional  roles. 

In  order  to  accomplish  this  task,  a  variety  of  measurements  are  being 
taken.    The  measures  include  (1)  providing  and  applying  effective  guidelines 
for  identifying  successful  and  unsuccessful  aides  and  homemakers;  (2)  measuring 
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the  aide's  and  homemaker* s  motivation;  (3)  and  :::3asuring  the  program  aide's 
and  homemaker's  recipe  skills.    The  next  step  is  to  examine  the  following 
questions: 

1.  Is  there -a  relationship  between  the  aides'  motivation  and  the  aides' 
demographic  characteristics? 

2.  Is  there  a  relationship  between  the  aides'  motivation  and  their  success  in 
the  program? 

3.  Is  there  a  relationship  between  the  aides'  recipe  skills  and  their  success 
in  the  program? 

4.  Is  there  a  relationship  between  the  homemakers'  motivation  and  the 
homemakers'  demographic  characteristics? 

5.  Is  there  a  relationship  between  the  homemakers'  motivation  and  their 
success  in  the  program? 

6.  Is  there  a  relationship  between  the  homemakers'  recipe  skills  and  their 
success  in  the  program? 

7.  Does  the  homemakers'  motivation  change  during  their  participation  in  the 
program? 

8.  Do  the  homemakers'  recipe  skills  change  during  their  participation  in  the 
program? 

9.  Does  the  aides'  motivation  change  during  their  employment  in  the  program? 
10.    Do  the  aides'  recipe  skills  change  during  their  employment  in  the  program? 

Background  of  the  Problem 

Motivational  Measurement.    In  determining  the  effect  of  motivation  on 
program  success,  it  becomes  necessary  to  adopt  a  useful  concept  of  motivation. 
The  criteria  utilized  in  the  adoption  of  a  motivation;:'^  theory  for  this  study 
were:    (1)   The  theory  must  possess  sufficient  predictive  validity  when  applied 
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to  the  population  of  concern;  and  (2)  there  must  exist  an  instrumentation  which 
could  be  adapted  for  use  in  a  field  setting.    The  theory  that  best  met  these 
criteria  at  this  time  was  the  achievement  motive,  conceptualized  by  McClelland, 
which  he  called  the  Need  for  Achievement. 

In  order  to  examine  how  well  the  McClelland  theory  fits  our  criteria,  it 
is  helpful  to  examine:    (1)    the  ways  in  which  the  Need  for  Achievement  (N-Ach) 
has  been  measured;  and  (2)  studies  with  low-income  or  culturally  diverse  groups 
in  which  the  theory  has  been  tested  for  predictive  validity. 

Scoring  the  Thematic  Apperception  Test  for  N-Ach  involves  two  steps.  The 
TAT  provides  a  tool  for  looking  at  the  effects  of  motivation  through  an 
examination  of  a  person's  fantasy.    Its  purpose  is  "...for  bringing  to  light 
the  strivings  of  the  individual  in  imaginative  stories  suggested  by  stimulating 
pictures  ..."  (23,  p.  107).    The  presence  of  N-Ach  is  indicated  when  an 
individual  includes  references  to  a  standard  of  excellence  and  a  concern  for 
competition  with  this  standard  even  if  the  individual  cannot  achieve  the 
goal  (22,  p.  110). 

In  order  to  measure  N-Ach,  the  individual  is  asked  to  tell  or  write  a 
story  in  which  words  in  achievement-related  categories  are  tagged.    It  is 
assumed  that  the  person  who  makes  many  such  references  to  achievement  in  his 
stories  is  more  highly  motivated  for  achievement  than  the  person  who  makes 
few  such  references. (23,  p.  146).    To  determine  the  number  of  such  achievement 
related  categories,  a  simple  count  of  the  ideas  can  be  taken  to  represent  the 
strength  of  the  person's  concern  with  achievement.    "The  count  has  been  called 
the  score  for  N-Ach"(24,  p.  43).    McClelland  assumes  that  "...the  thought 
processes  of  an  individual  are  in  part  determined  by  his  present  state  of 
motivation  and  that  in  complying  with  a  request  to  write  imaginative  stories. 


he  reveals  the  content  of  his  dominant  thoughts. ..indirectly,  his  state 
of  motivation."  (23,  p.  194). 

Therefore,  it  is  expected  that  the  aide  who  has  been  identified  as 
successful  will  score  higher  in  N-Ach  than  the  aide  classified  as  less  success- 
ful or  unsuccessful.    Due  to  the  very  fact  that  she  holds  a  job  requiring 
training  and  goal  orientation,- she  more  nearly  tends  to  fit  McClelland's 
model  of  a  high  need  achiever.    "People  who  are  highly  motivated  think  more 
often  in  anticipatory  and  generalized  terms.   They  are  concerned  with  general 
and  vague  life  goals"  (23,  p.  253).    They  are  willing  to  overcome  obstacles, 
take  risks,  and  delay  gratification. (26).    The  unsuccessful  aide  would 
presumably  be  a  low  N  Achiever,  for  the  low  need  achievers   are  categorized 
as  those  who  "...think  less  in  generalized  terms  and  are  more  concerned  about 
the  difficulties  in  the  way  of  achievement    (23,  p.  253);  therefore,  never 
striving  to  meet  or  to  consider  the  existences  of  a  "standard  of  excellence." 

The  literature  concerning  the  use  of  the  TAT  for  N  Achievement 
measurements  with  low-income  and  culturally  mixed  groups  reveals  conflicting 
opinions  and  findings.    Two  different  studies  found  the  TAT  for  N  Achievement 
inappropriate  when  working  with  low-income  and  cross-cultural  situations. 
Michel  in  his  article,  "Delay  of  Gratification,  Need  for  Achievement  and 
Acquiscence  in  Another  Culture,"  found  when  using  the  TAT  with  Trinidadian 
Negro  children,  that  it  was  difficult  to  get  adequate  and  appropriate  pictures 
for  use  with  different  cultures  (25).    Morgan,  when  using  the  TAT  with  laborers 
in  Michigan  State  found  it  difficult  to  get  imaginative  stories  which  provided 
enough  information  for  scoring  (27).   This  contention,  was  further  supported  by 
a  national  sampling  of  blue  collar  workers  cited  by  Morgan  in  "The  Achievement 
Motive  and  Economic  Behavior."    He  states  that  the  national  findings  indicate 
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that  the  TAT  was  difficult  ior  uneducated  and  not  very  verbal  people.  Their 
stories  were  too  short  and  interview  time  too  lengthy  (28). 

However,  other  studies  have  found  the  TAT  pictures  quite  beneficial  when 
used  with  low-income  populations  or  people  from  different  cultural  backgrounds. 
Cameron,  although  not  measuring  N  Achievement,  found  the  TAT  pictures  good 
stimulators  for  verbal  responses  when  studying  White  Canadian  and  Indian 
Canadian  children  for  successful  concept  learning.    Ms.  Cameron  found  that 
economic  status  was  a  more  important  variable  than  racial  or  cultural  back- 
ground in  the  kind  and  amount  of  response  (6).    The  TAT  of  scoring  N  Achieve- 
ment was  used  successfully  by  Hall  in  California  with  Mexican  American  youth 
from  middle  and  low  socio-economic  levels  (17).    Crockett  used  McClelland's 
TAT  technique  successfully  on  lower  middle  class  working  class  adults  (9). 
Other  studies  have  supported  the  use  of  the  TAT  pictures  for  measuring  N-Ach 
in  cross-cultural  situations  such  as  Cuban  American  children  (37),  male 
Hawaiian  American  teenagers  (34),  and  Black  undergraduate  university  students  (13). 
With  each  group,  this  projective  technique  proved  successful  in  eliciting 
adequate  achievement  related  responses. 

Due  to  the  conflicting  results  with  the  TAT  pictures  as  stimulators  of 
measurable  verbal  responses  for  this  particular  audience,  it  is  not  possible 
to  determine  whether  such  a  testing  technique  will  work  with  the  EFNEP  program 
aides  and  homemakers  before  the  technique  has  been  tested.     There  is  enough 
ev^tdence  to  indicate  that  the  TAT  measure  for  N  Ach  will  probably 
n)  measure  a  personality  characteristic  of  program  aides  and  homemakers  not  yet 
measured,  and  (2)  elicit  sufficiently  adequate  verbal  responses  for  an  accurate 
measurement  of  aide  motivation. 

The  audience  in  the  present  research  tends  to  deviate  from  thosf  groups 
of  people  previously  tested  for  N  Ach  with  the  TAT  stimuli  in  one  additional 
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important  way.    The  culturally  different  and/or  low-income  populations  used  in 
previous  researches,  as  noted,  have  tended  to  be  children,  college  students, 
or  male  blue  collar  workers,  as  opposed  to.  the  adult  women  from  the  low-income, 
racially  mixed  population  of  the  present  study.    It  is  assumed  that  the  TAT 
pictures  as  stimuli  will  work  with  this  new  audience  for  two  reasons. 

(1)  The  homemakers  (respondents)  are  being  interviewed  by  a  non- 
threatening  individual  (the  aide)  in  a  non-threatening  environment 
(the  homemaker's  own  home). 

(2)  The  homemaker  (respondent)  and  the  aide  (interviewer)  have  had  at 
least  two  se>sions  together  before  the  aide  has  attempted  an  inter- 
view, and  generally  a  feeling  of  confidence  has  been  established. 

Field  testing  of  the  procedure  and  preliminary  data  from  the  project 
indicate  that  the  population  did  respond  adequately  to  the  procedure  and 
instrumentation  outlined  later  in  this  paper.    A  sample  of  responses  indicate 
that  the  mean  length  of  response      ^37  wordswitha  standard  deviation  of  140,6 
words. 

The  Relationship  of  Skills  to  Change  in  Dietary  Behavior 

Several  studies  have  looked  at  the  relationship  between  education  of  EFNEP 
aides  and  homemakers  and  various  program  effectiveness  criteria.    For  example, 
in  Munger's  evaluation  of  the  Expanded  Nutrition  Program  (29),  she  attempted 
to  correlate  years  of  education  of  both  the  homemaker  and  the  aide  to  increases 
in  dietary  intake  adequacy.    She  found  no  significant  relationships.  Triplett 
(36)  did  find  a  relationship  between  years  of  education  of  aides  and  the  rating 
they  received  from  their  supervisors.    It  is  contended  here  that  the  question 
of  the  specific  skills  needed  to  understand  and  follow  a  recipe,  such  as 
measuring,  use  of  utensils,  or  heat  source,  has  not  been  investigated,  as  these 
skills  are  not  measured  by  years  of  schooling. 


It  seems  quite  appropriate  to  exatnine  the  following  question:    to  what 
extent  does  the  absence  of  certain  recipe  following  skills  limit  the  ability 
of  either  the  aide  to  teach  or  the  homemaker  to  learn  new  dietary  habits?  As 
presently  constituted,  the  Expanded  Nutrition  Program  in  the  State  of  Washington 
is  heavily  dependent  upon  recipes.    These  recipes  have  been  especially  written 
for  the  population  and  the  editor  stresses  both  ease  of  comprehension  and 
attention  to  basic  nutritional  information.    The  aides  discuss  these  recipes 
with  the  homemaker,  and  the  recipes  often  form  the  basis  of  the  day's  lesson 
plan.    The  recipes  are  always  left  with  the  homemaker  for  later  reference. 
This  kind  of  use  seems  to  suggest  that  an  appropriate  question  for  an  evaluation 
study  would  be  to  consider  whether  or  not  a  homemaker  who  is  severely  limited 
in  her  reading,  calculating,  measuring  and  cooking  skills  can  benefit  from  the 
program  as  presently  constituted. 

Note  the  unequal  relationship  being  hypothesized  here  between  skills  and 
change  in  dietary  behavior.    It  is  not  beirg  suggested  that  high  skill  levels 
should  lead  to  improved  nutritional  intake,  but  rather  that  low  skill  levels 
should  limit  the  possibility  of  changing  nutritional  intake.    Thus,  a  design 
which  attempts  to  correlate  skill  level  with  change  in  the  24-hour  food  recall 
should  show  low  correlations;  because  if  large  numbers  of  the  sample  which  are 
included  possess  sufficient  skills,  then  no  relationship  is  to  be  expected. 
The  important  questions  may  be  answered  by  employing  a  strategy  which  looks 
specifically  at  those  homemakers  (and  aides)  who     possess  particularly  low 
levels  of  skill   either  at  the  beginning  or  the  end  of  the  study.    In  order  to 
study  the  relationship  between  low  skill  levels  and  chang-  in  the  24-hour  food 
recall,  the  following  set  of  hypotheses  was  formed. 
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General  Hypothesis: 

While  high  recipe  following  skills  as  measured  by  the  Recipe  Skill 
Inventory  do  not  necessarily  lead  to  improved  nutritional  intake,  low  recipe 
following  skills  as  measured  by  the  Recipe  Skill  Inventory  will  limit  the 
possibility  of  changing  nutritional  intake. 

From  this  general  hypothesis  four  predictive  hypotheses  were  deduced 
corresponding  to  possible  patterns  which  might  be  found  in  a  longitudinal 
study.    They  are: 

H]:    If  the  homemaker  has  a  low  skill  level  (lower  quartile)  at  Time  1 
and  a  low  skill  level  at  Time  2,  then  there  will  be  no  significant 
change  in  nutritional  adequacy  as  measured  by  the  24-hour  food 
recall. 

If  the  homemaker  has  an  adequate  skill  level  at  Time  1  and  an 
adequate  skill  level  at  Time  2,  then  there  should  be  no  correlation 
between  skill  level  and  significant  changes  in  nutritional  adequacy. 

H3:  If  the  homemaker  has  a  low  skill  level  at  Time  1  and  an  adequate 
skill  level  at  Time  2,  then  it  is  predicted  that  there  will  be  a 
significant  positive  change  in  nutritional  adequacy. 

H4:    If  the  homemaker  has  an  adequate  skill  level  at  Time  1  and  a  low 

skill  level  at  Time  2,  then    it  is  hypothesized  that  some  significant 
negative  change  has  occurred  in  the  homemakers*  psychological  ability 
to  cope;  and  thus  either  no  change  or  a  negative  change  in 
nutritional  adequacy  will  occur. 


Background  for  the  Teaching  Skills  Inventory 

It  is  clear  that  any  evaluation  of  the  effectiveness  of  an  educational 
program  should  examine  the  interaction  in  the  instructional  setting.  A  great 
del  ^f  research  has  been  conducted  on  the  observation  and  coding  of  teaching 
settings.  Most  conceptual  systems  are  either  too  classroom  oriented,  such  as 
the  wide  variety  of  teacher  rating  sheets  utilized  in  various  school  settings, 
or  require  extensive  training  for  the  observer,  such  as  the  systems  developed 
by  Flanders  (11),  Bales  (1),  o'^  Medley  and  Mitzel  (25). 


For  this  research  it  was  necessary  to  find  or  develoo  an  instrument  which 
met  the  following  criteria.    First,  the  instrument  should  be  easy  to  use  in 
the  field.    It  should  rer<iire  a  minimum  of  training  for  the  observer,  and  the 
use  of  the  measure  should  be  as  inconspicous  as  possible  to  reduce  the  amount 
of  reactivity.    Second,  the  instrument  should  organize  observable  behavior 
rather  than  strictly  verbal  behavior.    Third,  in  the  setting  in  which  the 
EFNEP  is  carried  out  much  of  the  success  of  the  program  is  hypothesized  to 
come  from  a  continuing  relationship  between  the  aide  and  the  home.naker.    A«:  a 
result,  it  was  felt  that  the  instrument  should  focus  on  relationship  mainten- 
ance variables.    Fourth,  instruction  in  the  EFNEP  is  most  often  carried  out  in 
dyadic  or  very  small  groups,  so  the  measure  should  be  effective  in  small  group 
settings  which  are  conducted  in  a  wide  variety  of  locations.  Finally, 
because  the  EFNEP  program  is  conducted  under  such  a  variety  of  conditions, 
it  was  felt  that  the  instrument  should  focus  on  adaptive  behavior  of  the  aide 
to  changing  stimuli. 

A  conceptual  model  which  appears  to  be  useful  is  offered  by  Cu.  khuff  in 
^^"^  Helping  and  Human  Relations  (7).    He  defines  a  help-...d  relationship  in 
two  propositions  that  say  that  a  more  effective  helper  is  one  who  (1)  offers 
high  levels  of  facilitative  conditions,  such  as  communicating  high  levels  of 
respect  and  warmth,  and  (2)  initiateb  action-oriented  dimensions  in  a  helping 
relationship  such  as  confronting  the  person  being  helped  with  reality,  and 
being  able  U  art  with  immediacy  (7,  p.  37-39). 

Carkhuff's  model  was  originally  designs  for  the  therapeutic  setting,  but 
is  finding  increasing  use  in  other  helping  relationships.    For  the  purposes  of 
use  in  the  EFNEP,  it  appears  that  a  subset  of  the  original  model  should  be 
selected  for  development  into  a  field-oriented  instrument.    The  following 


behaviors  appear  to  be  directly  facilitative  of  aide  teaching  and  were 
tentatively  adapted  for  instrument  development:    tolerance,  energy  level,  and 
warmth.    Definitions  for  each  scale  and  behaviors  which  fit  the  definition 
were  identified. 

Research  Design  and  Instrumentation 

Research  Design.    The  research  is  a  longitudinal  study  comparing  the 
variables  for  two  groups  of  aides  independently  divided  into  a  successful  and 
unsuccessful  group.    This  division  will  be  performed  after  data  has  been 
collected  utilizing  the  agent's  ranking  of  aides  in  her  program  unit,  other 
aide's  rankings  of  themselves  in  relation  to  each  other,  and  success  in 
inducing  change  in  hoinemalcer  food  recalls. 

A  similar  strategy  is  being  employed  for  the  analysis  of  the  data  being 
collected  on  the  homemakers. 

Figure  1  presents  a  schematic  diagram  representing  the  design  for  the 
study.    Measurements  are  taken  for  both  N-Ach  and  skills  early  in  the  study 
and  again  after  six  months.    Criteria  for  distinguishing  among  homemakers  will 
be  the  homemaker's  performance  on  the  24-hour  food  recall,  the  aide's  judgement 
of  the  homemaker's  willingness  to  participate  in  the  program,  the  aide's 
judgement  of  the  increase  in  the  homemaker's  utilization  of  taught  nutrition 
information-,  and  the  records  of  regularity  of  lessons. 

Sample 

The  project  intended  to  include  as  the  population  (1)  all  EFNEP  aides  in 
Washington,  and  (2)  all  new  homemakers  enrolled  in  the  EFNEP  program  between 
August  1,  1972,  and  November  30,  1972.    Due  to  a  variety  of  uncontrollable 
circumstances,  howeve-,  not  all  aides  and  homemakers  were  included. 
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FIGURE  1. 


Research  Objectives 


OBJECTIVES 

EVIDENCE 

INSTRUMENiS 

!•  Are  there  any  measureable 
changes  over  time  in  the 
program  aide's  and 
homemaker's  N-Achievement 
as  defined  by  McClelland? 

N-Achievement  score 
from  first  and  second 
interviews. 

Taped  interviews  and 
computer  analysis. 

2.  Are  there  any  measureable 
changes  over  time  in  the 
program  aide  s  and 
homemaker's  recipe  skills? 

Recipe  Skill  Inventory 
Scores  from  first  and 
second  evaluation  for 
aidci  and  homemakers* 

RSI  1:  Homemakers 
RSI  2:  A^*des 

3.  Are  there  any  measureable 
characteristic  differences 
between  aides  who  have  been 
identified  as  successful  and 
aides  who  have  been  identified 
as  unsuccessful  in  terms  of 
N-Achievement  and  homemaking 
skii IS? 

For  identification  of 
successful  aides: 

a.  Agent's  ranking  of 
aides* 

b.  Aides'  selection  of 
top  quartile  of  aides. 

c.  Change  in  nutri- 

I 1 ona 1  in udKc  ot  aioes 
homemakers  after  6  months 
in  the  program.' 

a.  Forms  for  ranking 
aides  by  agents. 

b.  Form  for  top  quarter 
aides  in  county  by 
other  aides. 

c.  Federal  24- Hour  Food 
Recall  form  from  Family 

r\6C0rQS. 

4.  Are  there  any  measureable 
characteristic  differences 
between  program  homemakers 
who  have  been  identified 
as  successful  and  program 
homemakers  who  have  been 
identified  as  unsuccessful 
in  terms  of  motivation 
and  homemaking  skills? 

For  identification  of 
successful  homemakers: 
d.  Aide's  ranking  of 
her  homemakers. 
b.  In  nutritional  intake 
after  6  months  with 
the  program. 

a.  Aides'  ranking  form 
for  homemakers. 

b.  Federal  24-Hour  Food 
Recall  form  from  Family 
Records. 
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Illnesses  in  both  groups,  termination  of  the  program  by  .ome  homemakers,  and 
the  inability  of  some  aides  to  handle  the  interview  situation  eliminated 
members  of  both  nopulations  from  the  study.    Of  the  759  enrolled  homemakers, 
the  research  population  includes  502  homemakers.    Of  the  88  aides  in  the 
counties  to  be  studied,  81  participated  in  the  research.    Eight  of  the  nine 
EFNEP  counties  comprised  the  actual  field  study,  whereas  homemakers  and  aides 
from  the  ninth  county  served  as  the  pilot  population  for  developing  and 
testing  both  training  procedures  and  instruments,  and  therefore  were  not 
included  in  the  actual  field  population. 

The  aides  included  in  the  study  had  the  following  characteristics.  Data 
was  provided  for  all  elides  in  the  counties  studied,  not  just  those  who 
participated.    (See  Table  1  and  Table  2) 

Analysis  of  Data 

The  collected  TAT  stimulated  interviews  will  be  subjected  to  a  content 
analysis  utilizing  the  computer-aided  content  analysis  programs  of  the  General 
Inquirer  (32).   The  data  are  keypunched  and  then  each  word  or  phrase  is  tagged 
as  belonging  to  one  (or  more)  pre-determined  categories.    Coherent  categories 
are  developed  prior  to  data  collection  and  keypunched  and  entered  as  a  part 
of  the  computer  program.   As  each  word  of  text  is  read  into  the  computer,  the 
program  looks  up  that  word  in  the  specified  dictionary  and  tags  the  words  with- 
indicators  specifying  the  appropriate  categories.   At  a  later  time  various 
counts  are  made  of  each  of  the  categories  in  order  that  statistical  analyses 
may  be  made.    Olgivie  and  Woodhead  have  developed  a  dictionary  for  use  with 
the  General  Inquirer  programs  (32). 

The  statistical  design  will  utilize  a  discriminate  analysis  in  which  the 
successful  vs.  unsuccessful  categories  will  be  utilized  as  the  dependent 


Table  1.    Aide  Characteristics 
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Etnnic  Background  N=88 


Work  Load  N=88 


White 

Black 

Chicano 

Indian 

Oriental 

Other 


55% 
23% 
13% 

9% 

0 

1.1% 


Language  Spoken  N=88 

English  only  76% 

English  &  Spanish  16% 

English  &  Indian  5% 

English  &  Oriental  0 

English  &  Other  3% 


half time  25% 
3/4  time  69% 
full  time  6% 


Type  of  Instructional  Contact  N=88 

group  10% 
half  group/half  individual  32% 
individual  58% 


Total  Family  Income  N=88 
mean=$8,322 

standard  deviation=$2,083 


Education  N=88 

mean=11.2  years  of  schooling 
standard  deviation=l .2 


Geographic  Location  N-88 

urban  59% 
rur.  38% 
fam.  3% 


Families  Enrolled  Per  Aide  N=88 
mean=32 

standard  deviation=8.9 


Age  N=88 

mean=43.6  years 
standard  deviation=5.6 


Marital  Status  N=88 


single 
widowed 
married 
divorced 


5% 
6% 
75% 
11% 


separated  3% 


Aide  Family  Size  N=88 


mean=5.4  persons 
standard  deviation=2.0 


Source  of  Income  In  Addition  to  Aide's  Salary 


yes  85% 
no  15% 


Table  2.    Homemaker  Characteristics. 
N  varies  slightly  from  item  to  item  due  to  incomplete  data  in  certain  areas. 


hr.ic  Background  N=4?8 


wi.:te 
Black 
Chicano 
Indian 
Oriental 
Other* 


72% 
7% 

10% 
9% 
6% 
1% 


*East  Indian,  Eskimo  Indian 


Federal  Assistance*  N=500 


none 
some 

food stamps 
wel fare 


35% 
65% 
60% 
48% 


*Some  families  receive  more  than 
one  kind  of  assistance. 


Language  N=492 

English  only 
Enyiish  &  Spanish 
English  &  Indian 
English  &  Oriental 
English  &  Other 


Education  N=497 

8th  or  less  20% 
9-12  73% 
beyond  7% 

median=l 0.828 


N=497 


86% 
9% 
3% 
0 

2% 


mean=28.5  years 
standard  deviation=8.65 


Number  of  Fair^-^ly  Members  .  N=497 

mean=4.24  persons 
standard  deviation=l .2 


Geographic  Location  N=505 

urban  67% 
rural  30% 
farm  3% 


Famny  Income  -  Monthly  N=489 

under' $84  2% 

84-167  8% 

168-250  26% 

251-333  29/, 

334-417  20% 

418  and  over  14% 


median=$300.81 
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variables.    Each  of  the  other  variables  will  be  examined  to  see  to  what  extent 
they  contribute  to  predicting  the  dependent  variables. 

Development  of  Instruments 

Measurement  oF  NW\ch,    In  th:  development  of  an  instrument  for  the 
measurement  of  motivation,  stress  has  been  placed  on  an  instrument  that  was 
easy  to  use  in  the  field,  as  nonreactive  as  possible  to  spurious  influences  in 
the  measuring  situation,  but  which  would  yield  accurate  discriminations  between 
those  individuals  with  a  high  need  for  achievement  and  those  with  a  low  need  for 
achievement.    Because  large  amounts  of  data  were  involved,  the  instrumentation 
including  analysis  should  also  be  economical  in  coding  and  scoring  costs.  The 
machine  coding  of  natural  language  interviews  stimulated  by  ambiguous  stimuli 
was  selected  as  best  meeting  these  criteria. 

There  are  several  reasonably  well -developed  theories  of  r  ^-^vation  which 
could  be  used  to  determine  chaage  in  motivation  as  a  result  of  educational 
programs,  or  to  relate  certain  mocivational  patterns  to  obtained  outcomes  of 
educational  programs.    One  reason  for  the  apparent  lack  of  such  studies  is  the 
di.*icuTty  of  administering  psychological  instruments  to  program  participants 
in  voluntary  programs,  especially  if  those  participants  are  of  certain  socio- 
economic classes.   Difficulties  in  gathering  such  data  include  reluctance  of 
participants  ti  take  psychological  instruments  because  of  suspicion,  limitations 
of  reading  ability  in  terms  of  comprehension,  and  unknown  participant  reactions 
to  certain  stimuli  presented  through  the  instrument  itself.    In  order  to 
investigate  motivational  questions,  it  seems  necessary  to  collect  data  that  are 
naturally  produced,  which  can  be  validly  and  reliably  collected  and  analyzed, 
and  which  are  very  sensitive  to  differences  in  motivational  states. 
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The  meth'od  of  content  analysis  of  natural  language  appears  promising  in 
this  respect.   Researchers  and  theorists  of  a  variety  of  orientations  and 
disciplines  have  been  able  to  use  the  analysis  of  natural  language  to  develop 
and  test  motivational  theories  of  reasonable  utility  and  precision.  Motivational 
theories  which  have  been  tested  utilizing  content  analytical  methodologies 
include  McClelland's  theory  of  the  need  for  achievement  (23),  Erikson's  Ego 
Crises  Theory  as  studied  by  Boyd  (5),  various  studies  utilizing  the  Thematic 
Apperception  Tests  (37,  30),  and  studies  of  the  Rorschach  technique  (10,  22). 
Results  from  these  studies  indicate  that  it  is  difficult,  but  feasable  to  infer 
theorr.t'cal  motivational  states  based  on  the  evidence  of  the  use  of  certain 
natural  lapquage  words  and  patterns.    Such  inferences  may  then  be  used 
predictively  in  a  variety  of  research  applications. 

Some  advantages  of  the  use  of  language  as  research  data  include  the  fact 
that  natur  1  language  protocols  may  with  some  ingenuity  be  gathered  in  such  a 
way  as  to  reduce  the  amount  of  interactivity  due  to  the  instrumentation. 
Second,  data  once  gathered  may  be  shared  with  colleagues  in  order  that  the 
analysis  may  be  replicated  by  other  competent  researchers.    Third,  data  may  be 
utilized  from  situations  in  which  the  presence  of  an  observer  would  be  impossible. 
Historical  records,  diplomatic  communications  and  correspondence  can  be  analyzed 
even  though  the  original  individuals  are  no  longer  available. 

Content  analysis  of  stories  produced  in  response  to  ambiguous  stimuli  was 
chosen  oS  a  method  for  this  study  because  the  data  are  not  dependent  upon  the 
respondent's  ability  to  read  or  write,  an  important  consideration.  Second, 
many  have  reported  that  the  participants  shared  a  strong  oral  tradition,  and 
it  was  suggested  that  an  oral  interview  conducted  by  a  trusted  individual  was 
the  best  means  for  gathering  data  concerning  the  motivational  state  of  the 


19 


participants  at  the  beginning  and  after  a  six-month  period  of  enrollment  in 
the  Expanded  Foods  and  Nutrition     Education  Program.    In  addition,  instrumen- 
tation  existed  to  test  several  theoretical  approaches  to  motivation. 

One  problem  with  content  analysis  until  recently  was  the  vast  clerical 
requirement  needed  for  categori*""  *     Someone  had  to  do  .much  of  the  coding 
by  hand.    As  Holsti  (18,  p.  6^3)  points  out,:    "Finally,  content  analysis 
usually  requires  skilled  and  sensitive  coders,  the  very  type  of  persons  who 
soon  become  bored  and  frustrated  by  the  tedious  and  repetitive  nature  of  the 
task."   Under  these  conditions,  prdbTems  with  intercoder  agreement  (reliability) 
and  coder  accuracy  (.validity)  are  quite  serious.    One  recent  development  has 
alleviated  these  problems  so  dramatically  that  the  content  analytic  method 
is  enjoying  a  resurgance  of  usage.    This  development  is  the  use  of  computer 
programs  which  are  designed  to  reduce  the  drudgery  of  the  coding  process. 
Though  obviously  the  use  of  a  computer  program  does  not  lessen  the  researcher's 
need  to  i»        validity  of  his  procedure,  the  problem  of  differences  intro- 
duced because  of  coder  inattention  or  boredom  are  no  longer  important.  Data 
are  analyzed  the  same  way  every  time  unless  there  is  an  error  in  the  keypunching. 

Early  compu^3r  programs  were  limited  to  word  frequencies  either  organized 
by  the  word  itself  or  by  analytical  categories.    More     cent  programs  allow  a 
great  deal  of  rltxibility  in  the  unit  to  be  considered.    With  the  General 
Inquirer  programs  developed  at  Harvard  University,  it  is  now  possible  to  analyze 
data  oy  category,  by  word  or  by  other  contextual  units.    It  is  now  possible  to 
examine  phrases  or.  to  "check  for  concurrence  of  certain  categories.  Dictionaries 
have  been  developed  for  the  General  Inquirer  for  a  number  of  different  appli- 
cations.   The  Stanford  political  dictionary  is  based  on  the  theoretical  work 
of  semantic  differentiation  (30,  31).    McLaughlin  (35)  developed  a  dictionary 
to  score  responses  to  the  question  of  Who  Am  I  (WAI).    Most  importantly  for 
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this  research,  D-  M,  Ogilvie  and  Louise  Woodhead  of  Harvard  developed  a  diction- 
ary that  scores  protocols  utilizing  the  rules  developed  by  McClelland  for 
manual  scoring  of  achievement  imagery  in  projective  test  materials  (35,  p-  191 )• 
There  are  many  more.    One  of  the  dictionaries  that  has  been  used  in  a  wide 
variety  of  studies  is  the  Harvard  Psychsociological  Dictionary  developed 
at  the  Laboratory  of  Social  Relations  at  Harvard  University  for  studying  - 
psychological        sociological  materials  (35,  p,  170), 

The  use  of  such  tested  dictionaries  should  increase  the  possibility  of 
identifying  motivational  states  that  predispose  an  individual  to  accept  educa- 
tional attempts  to  change  nutritional  behavior. 

The  Research  Instrument 

When  developing  instruments  for  measuring  motivation,  it  was  imperative 
to  find  a  tool  which  would  encourage  homemakers  and  aides  to  talk  about  them- 
sslve:>,  their  hopes  and  aspira^*       so  that  a  content  analysis  of  words 
indicating  a  need  for  achievp' .  .t  (N-Ach)  could  be  performed  on  the  obtained 
data. 

A  variety  of  stimuli  was  piloted  using  an  audience  that  closely  resembled 
the  intended  population  of  the  study.    A  group  of  High  School  Equivalency 
students  from  low-income  and  minority  group  backgrounds  served  for  the  first 
pilot  testing  of  instruments. 

First  of  all,  a  task  questionnaire  was  administered  following  the  suggestions 
of  Morgan  (27),    They  were  asked^  "How  do  you  think  most  people  would  feel  if 
a  boy  of  theirs  chose  each  of  thes^  types  of  work?"   Then  a  list  of  possibilities 
was  offered,  fror  farm  labor  to  professional  positions.    Another  question  was 
tested  using  the  guidelines  of  Michel  (26)  from  his  suggestions  for  cross- 
cultural  situations.    An  open-onded  question  was  asked  where  the  following 
behavioral  choice  v/as  given. 
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1-    I  would   rather  get  $10  right  away  than  have  to  wait  a  whole  month 
to  get  $30,  or 

2.    I  would  rather  wait  to  get  a  much  larger  gift  much  later  than  get  a 
small  one  now. 

Michel  contends  that  delayed  reinforcement  is  directly  and  positively  related 
to  motivation  and  achievement:    "the  ability  to  delay  gratification  is  the 
reward  value  of  working," 

Another  suggestion  of  Michel,  piloted  with  this  audience,  was  the  use  of 
the  question:    "Let's  pretend  there's  a  magic  man,  and  he  can  change  you  into 
anything  you  want;  what  do  you  want  to  be?"   The  respondent  is  to  give  a 
one-word  answer. 

With  the  same  group  of  people  the  "Who  Am  I?"  question  was  asked,  and  the 
respondents  were  allowed  to  say  as  much  as  they  wanted  about  themselves  in  any 
language  that  was  most  comfortable. 

The  last  tool  used  to.  elicit  verbal  responses  was  a  set  of  especially  drawn 
pictures  similar  to  the  Thematic  Apperception  Test  pictures.    The  pictures  were 
selected  with  cultural  and  situational  cues  to  assist  the  respondent  in  relating 
to  the  pictures,  i^^sre. behavior,  correlated  to  the  achievement  motive  might  occur(22). 

All  responses  were  tape  recorded  and  analyzed  for  amount  and  quality  of 
responses  as  they  relate  to  the  use  of  conteni;  analysis.    When  the  respondents 
were  asked  their  opinion  regarding  the  different  methods,  the  majority  felt  . 
that  it  was  easier  to  respond  to  the  pictures.    This  response  concurred  with 
the  information  and  length  of  responses  available  on  the  tapes.   The  longest 
and  most  achievement-oriented  responses  were  a  result  of  the  use  of  the  pictures. 
They  were  most  uncomfortable  with  the  "Who  Am  I?"  question.    It  was  on  this  basis 
that  the  taped  interview  with  the  picture  stimulus  was  chosen  for  field  piloting 
with  program  aides  and  homemakers  in  the  selected  pilot  county. 
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When  piloting  the  use  of  the  pictures  with  the  recorders,  the  aides  were 
instructed  in  the  non-directive  interview  techniques,  the  use  of  the  tape 
recorder,  and  hov;  these  related  to  the  pictures.  "They  were  interviewed  and 
had  practice  interviewing.    The  aides  were  then  encouraged  to  apply  these 
techniques  with  as  many  program  homemakers  as  possible.   After  their  experiences 
with  the  interviews  and  pictures,  it  became  apparent  that  this  method  would 
work  in  the  field  with  the  majority  of  homemakers. 

The  Coding  Rules  For  N-Ach 

Content  analysis  procedures  look  primarily  at  different  kinds  of  thematic 
contingencies,  and  an  overall  score  is  made  as  to  whether  achievement  imagery 
is  judged  to  be  present  in  a  story.    The  General  Inquirer  content  analysis 
method  was  developed  to  duplicate  the  original  hand-scoring  system  developed 
by  McClelland  for  TAT  responses.    The  system  is  concer-ed  only  with  analysis 
of  those  words  that  are  judged  to  express, need  for  achievement.   All  other 
words  are  discarded  (35). 

Each  story  or  interview  is  placed  into  one  of  hree  categories: 
(1)   Those  with  achievement  imagery-AI;  (2)  those  with  doubtful  achievement 
imagery-TI;  (3)  or  those  with  no  achievement  imagery-UI.    The  AI  stories  are 
further  checked  for  subcategories.     There  are  14  different  subcatego'^ies. 
which  provide  both  a  grammatical  and  thematic  analysis. 

The  different  categories  in  the  achievement  analysis  include: 

1.  "Need"  words,  such  as  wants,  desires.^  hopes,  and  yearns. 

2.  "Success"  words  such  as  fame,  glory,  honor,  and  praise. 

3.  "Failure"  words,  such  as  error,  incorrect,  mistake,  ruin,  and  blunder. 

4.  Verb-positive  words.    This  category  includes  activity  words  relating 

to  the  concept  of  achievement  (such  as  doing,  making,  inventing,  etc.). 
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5.  Block  words.    Includes  words  that  stand  in  the  way  of  or  "block"  goal 
attainment. 

a.  environmental  obstacles  such  as  broken,  damage,  crisis 

b.  personal  obstacles  words  such  as  confidence,  ineptness,  awkwaruness 

6.  Affective-positive.    Includes  words  tha^  denote  joy,  happiness, 
delight. 

7.  Affect-negative.   Tags  words  that  express  sorrow,  anger,  disappointment. 


The  following  seven  categories  correspcud  to  the  3  basic  criteria 
established  by  McClelland.    One  or  more  of  these  criteria  must  be  met  in  order 
for  the  docup^int  to  be  catecjorized  as  exhibiting  N-Achievement. 

I.    Competition  with  r.ome  standard  of  excellence: 

8.    Compete.    This  category  relates  to  McClelland' s  definition  of  a 
need  achiever,  as  one  who  must  compete  with  a  standard  of 
excellence  and  excel    at  it.    Words  tagged  in  this  category  sogges 
that  the  individual  is  excelling  at  a  competitive  activity.  This 
category  includes  words  such  as  win,  gain,  overtake,  and  surpass. 

^"  '9.    Adverb-Positive.  This  category  picks  up  words  that  express  a 

desire  to  do  the  job  well  and  thoroughly,  that  is,  work  carefully, 
study  thoroughly. 

II.    Extraordinary  accomplishments: 

10.  Value-positive.    This  category  refers  to  culturally  valued  goals 
as  they  relate  to  an  achieving  activity;  words  such  as  discovery, 
creating,  and  curiosity. 

11.  Adjective-po;>itive.    This  category  refers  to  modifiers  that  relate 
to  the  "extraordinary"  aspects  of  the  accomplishment;  words  such 
as  great,  powerful,  promising. 

III.    Long  term  involvement: 

12.  Time.    Not  often  a  useful  category,  but  selected  to  point  out 
words  sucn  as  lifetime,  life,  years,  etc. 

13.  To-be.    This  tag  defines  the  words  to  be,  to  become,  of  becom...g, 
become,  becomes,  and  becoming.    These  words  are  examined  in 
relationship  to  other  key  words  to  provide  a  link  in  scoring 
achievement  imagery. 
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14.    Role-positive.    This  tag  looks  at  the  category  of  titles  of 

various  roles  that  are  considered  achieving  roles  in  this  society, 
such  as  doctor,  surgeon,  professor,  lawyer • 

There  are  certain  category  combinations  which  constitute  the  rules  to  be 

followed  when  the  stories  are  scored  for  Achievement  Imagery  (AI),  These 

patterns  correspond  to  the  three  criteria  defined  by  McClelland,    To  be  scored 

as  indicating  achievement  imagery,  a  story  must  indicate: 

1.  Competition  with  a  standard  of  excellence: 
Rule  1.    success  +  affect  positive. 

Rule  1.    failure  +  affect  negative, 
Rule  3.    verb-positive  +  adverb  positive. 

2.  Unique  accomplishment: 

Rule  1.    value  positive  +  verb-positive. 
Rule  2-    adjective  positive  +  value  positive. 

3.  Long  term  involvement: 

Rule  1.    need  +  to  be     role  positive. 

Rule  2-    need     to  be  +  adject-fve  positive- 
One  last  rule  was  added  to  McCl el  land's  criteria  to  cover  sentence  patterns 
and  seq'jences  which  contained  the  word  success.    For  example,  when  The  document 
contains  a  sequence  that  states  that  "the  hero  was  (or  would  be)  successful", 
the  rule  to  cover  this  is,  to  be  +  success  =  AI. 

Scoring  for  TI  (Doubtful  imagery) 

If  a  story  does  not  fulfill    he  3  categories  for  AI  scoring  as  established 
by  McClelland,  but  contains  references  to  achievement,  it  is  scored  TI, 
doubtful  imagery.    Usually  words  tagged.  Block,  are  also  scored  TI ,  since  the 
tag  usually  shows  concern  with  tasks.    The  story  or  document  is  scored  TI  if 
it  contains  two  verbs  that  have  been  identified  as  Verb-positive.    This  usually 
indicates,  as  does  the  category  Block,  that  a  task  activity  is  being  conveyed. 
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Recipe  Skill  Inventory 

One  variable  that  interested  the  research  team  was  the  basic  knowledge 
and  application  of  cooking  skills  for  both  the  homemakers  and  aides.    In  order 
to  examine  these  skills,  it  was  necessary  to  develop  an  instrument.  In 
approaching  this  task,  several  suggestions  by  Bayton  (2)  helped  identify  the 
direction  to  be  taken.    First,  there  was  a  need  to  establish  a  valid  definition 
of  what  constitutes  an  adequate  performance,  and  second,  there  was  a  need  to 
evaluate  present  methods  used  to  satisfy  performance  criteria.    Since  much  of 
the  field  work  of  aides  with  homemakers  centers  around  the  use  and  application 
of  program  recipes,  the  ability  and  knowledge  of  basic  recipe  skills  was 
judged  to  be  mandatory.    At  that  point,  the  search  was  narrowed  to  finding  an 
instrument  which  would  examine  and  measure  those  kitchen  skills  which  aided  in 
successfully  reproducing  a  recipe.   A  variety  of  available  instruments  were 
screened  for  applicability  to  the  present  research.    Several  were  found  which 
approximated  the  desired  instrument.    Shipley  of  Iowa  State  developed  a  check- 
list for  "Competencies  Needed  by  Homemaker/Health  Aide"  (33).    This  checklist 
included  some  of  the  skills  which  were  of  interest,  but  it  also  collected 
inform?ition  not  available  to  the  program  aide.    "A  Checklist  for  Management  in 
Food  Preparation."  (15)  also  contained  items  of  interest,  but  was  not  designed 
tD  be  used  with  low-income  family  situations  where  few  modern  kitchen 
conveniences  are  available. 

The  scale  most  similar  to  that  needed  was  the  "Foods  Performance  Scale" 
developed  by  Gallogly  (12).   Many  of  the  items  were  adopted  for  this  study's 
inventory.    The  use  of  this  particular  scale  in  its  entirety  was  rejected, 
however,  due  to  the  limited  discrimination  of  the  scaling  procedure. 
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At  this  point,  the  team  interviewed  both  home  economists  dhd  homemakers 
to  find  out  what  they  considered  tc  be  the  most  basic  skills  needed  in  order 
to  successfully  prepare  a  recipe.   With  this  list,  and  with  knowledge  of  pro- 
gram needs  and  limitations,  combined  with  items  from  previously  developed 
checklists,  two  new  inventories  were  developed.    The  first  inventory  (RSI-1) 
was  designed  to  be  used  by  aldu   with  homemakers  for  evaluating  basic  skills 
in  recipe  preparation.    The  sec.  '.i  inventory  (RSI-2)  was  designed  to  be  used 
by  ^ipervising  agents  with  aides  for  evaluating  basic  knowledge  of  abbreviations, 
measurements,  safety  procedures  in  the  kitchen,  organization,  and  planning  of 
program  recipe  presentations  to  the  homemakers. 

The  ReciDe  Skill  Inventory  des-gned  for  use  with  the  homemakers  underwent 
several  revisions  as  the  result  of  field  trials.    The  instrument  was  used  in 
beginning  food  laboratories  at  Washington  State  University,  revised,  and  then 
tested  in  the  pilot  county.    The  aides  were  trained  in  the  use  of  the  RSI  and 
they  then  used  it  in  the  field  for  several  weeks.    Based  on  preliminary 
intercoder  agreement  studies  as  well  as  comments  from  those  who  used  the  first 
draft  of  the  instrunent,  certain  revisions  were  made  in  the  instrument. 

Reliability 

''  the'^Recipe  Skill  Inventory  is  a  behavior  checklist,  and  thus  the  accuracy 
with  which  behavior  is  assessed  depends  upon  both  the  clarity  of  the  instru- 
m  ,it's  categories  and  the  effectiveness  of  the  training  procedures.  The 
criterion  measurement  for  reliability  is  the  interjudge  agreement  among 
several  individuals  who  have  witnessed  the  same  behavior  after  experiencing 
the  training  program. 

The  training  program  for  the  use  of  the  RSI-1  usually  takes  about  5  hours. 
First,  the  trainer  sits  down  with  those  who  will  use  the  instrument,  goes  over 
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each  item  explaining  the  purpose  of  the  item  and  giving  several  examples  ct 
behavior  which  would  qualify  for  a  positive  score.    Any  questions  are 
answered. 

A  recipe  is  prepared  and  observed.    The  RSI-1  is  completed.    Then  the 
trainer  goes  over  the  answers  item  by  item  rei.iforcing  correct  responses  and 
clarifying  rules  fbr  those  who  have  erred,   A  second  recipe  is  prepared  and 
obser  -d.    Again,  the  RSI-1  is  completed  and  discussed.    The  importance  of 
using  the  standard  recipe  is  stressed,  and  the  consequences  of  not  using  the 
standard  recipe  are  demonstrated. 

Since  the  RSI-1      sensitive  to  the  way  in  which  it  is  used,  continuing 
studies  are  being  made  during  aide  training  sessions  to  insure  that  the 
instrur  ^nt  is  being  reliably  used. 

Some  preliminary  studies  of  inter  judge  agreement  indicate  th^it  the  range 
of  percentage  agreement  is  sufficiently  high  to  indicate  that  the  instrument 
is  easy  to  understand  and  apply, 

FIGURE  2, 
Interjudge  Reliability  Trials 
N  Percentage  Agreement 

Trial  1  6  88% 
Trial  2  6  82% 

Reactivity  and  the  Recipe  Skill  Inventory 

Webb  et  al  (38)  have  discussed  the  problems  which  occur  when  research 
instruments  influence  the  data  collected  in  selected  ways.    Parti  :ular  care  was 
taken  to  design  the  methodology  for  using  the  RSI-1  in  order  to  minimize  the 
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data  distorting  influences  due  to  the  data  collection  itself. 

At  the  outset  it  was  realized  that  the  recipe  following  skills  being 
displayed  on  the  day  that  the  aide  is  present  are  already  biased  in  the 
direction  of  more  attention  to  detail  than  normal.    There  did  not  appear  to  be 
much  that  could  be  done  either  to  check  this  suspicion  or  to  control  possible 
bias  developed  because  of  the  presence  of  the  aide.    However,  the  aides  try  to 
make  the  homemaker  comfortable,  to  put  her  at  ease,  and  to  elicit  behavior  that 
is  as  normal  as  possible. 

When  it  becomes  necessary  to  collect  evidence  of  recipe  following  skills 
by  direct  observation,  the  problem  of  reactivity  becomes  more  difficult.  In 
an  attempt  to  not  influence  the  homemaker  unduly,  the  instrument  was  designed 
in  such  a  way  as  to  be  able  to  be  filled  out  by  the  aide,  outside,  after  her 
visit.    The  stimulus  (recipe)  was  standardized  and  the  same  one  was  used  each 
time.    The  recipe  was  especially  designed  to  elicit  a  variety  of  skills,  such 
as  measuring,  mixing,  chopping,  utensil  utilization,  and  organization.  The 
standard  recipes  were  published  by  Extension  in  the  same  format  as  other 
program  recipes,  and,  thus,  to  the  homemaker^  the  day  that  the  RSI  is  taken  is 
like  any  other  visit  by  the  aide.    There  is  a  recipe  to  prepare  and  the  aide 
discusses  nutritional  information.   The  RSI  is  not  taken  on  the  same  day  as  the 
interview.    After  the  homemaker  has  prepared  the  recipe  and  the  lesson  is  over, 
the  aide  fills  out  the  RSI  outside  the  home  as  soon  as  possible. 

Development  of  the  Teaching  Skills  Inventory 

In  developing  the  Teaching  Skills  Inventory  (TSI),  the  atteippt  is  to 
develop  an  instrument  which  is  easy  to  use  in  the  field,  nonreactive  in  terms 
of  distortion  of  the  situation  being  studied,  and  which,  of  course,  measures 
variables  which  are  considered  important.    The  development  of  the  TSI  has  not 
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progressed  as  far  as  the  other  instruments.    As  the  background  section 
indicated  scales  have  been  developed  for  tolerance,  energy  level,  and  warmth- 

At  first  glance,  these  scales  may  appear  as  either  strange  or  insufficient 
for  an  Inventory  of  Teaching  Skills-    However,  it  is  important  to  remember  the 
kind  of  teaching  being  conducted-    There  is  generally  just  the  aide  and  one 
homemaker  present,  though  small  groups  of  three  or  four  are  sometimes  brought 
together-    The  homemaker* s  children  are  constantly  present-    The  kitchen  ;iay  or 
may  not  have  the  necessary  basic  utensils  needed-    Basic  sanitary  practices 
may  be  neglected-    In  this  kind  of  setting,  the  aide's  teaching  is  accomplished 
through  a  consultative,  helping  relationship-    Thus,  those  interpersonal  skills, 
tolerance  and  expression  of  warmth,  plus  the  appearance  of  sufficient  energy 
have  been  chosen  as  possibly  important  variables-    It  is  clear  that  th'^se 
skills  are  not  ordinarily  thought  of  as  teaching  skills,  and  yet  ther-^  is  some 
reason  to  hypothesize  that  these  variables  are  important,  and  underlie 
successful  teaching  in  the  informal  setting- 

At  the  present  time  the  scales  have  been  defined  and  reviewed  by 
supervising  agents-    The  instrument  has  not  yet  been  field  tested,  nor  a  train- 
ing program  developed  to  teach  the  necessary  skill  to  utilize  the  instrument- 
Further,  development  is  planned  for  this  instrument  during  the  final  part  of 
this  project- 
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INSTRUCTIONS  FOR  THE  AGENT  ADMINISTERING  THE  RSI-2  TO  THE  PROGRAM  AIDES: 

The  RSI-2  is  divided  into  3  parts,  and  each  part  requires  a  different  method  and 
approach  to  evaluation. 

PART  I:    On-the-job  Evaluation: 

!•    Administration  of  this  part  is  similar  to  that  of  the  RSI-1,  in  that 

the  responses  obtained  are  the  result  of  a  home  visitation  with  the 
aide. 


2.    This  inventory  can  be  filled  out  after  one  visit  or  a  series  of  visits. 
PART  II:  Abbreviations  and  Measurement  Evaluation: 

1.  Part  II  provides  for  examining  the  aides*  knowledge  of  specific 
items,  such  as  abbreviations  and  measurement. 

2.  Part  II  may  be  administered  in  a  group  situation  or  to  each  aide 
individually. 

3.  For  Part  II,  each  supervising  agent  should  select  the  following 
measuring  utensils  and  label  them  as  suggested: 

1  dry  ingredient  cup-letter  A  1  cup  liquid  measure-letter  E 

1/2  dry  ingredient  cup-letter  B  1  tablespoon-letter  F 

1/4  dry  ingredient  cup-letter  C  1  teaspoon-letter  G 
1/3  dry  ingredient  cup-letter  D 

Tape  the  letter  label  to  each  of  the  utensils  and  set  them  out 
on  a  table  so  that  those  taking  the  test  can  see  all  of  the 
utensils. 


PART  III:  Knowledge  of  Safety  Practices: 


1.  Part  III  consists  of  the  aide  looking  at  the  picture  and  identifying 
the  safety  hazards  present.    She  is  to  circle  all  that  she  finds. 
There  are  l4.    The  answers  will  accompany  the  picture  for  the  agent 
to  use  in  scoring. 

2.  Part  III  may  be  administered  in  a  group  situation  or  t'  each  aide 
individually. 


GENERAL  INSTRUCTIONS: 


1.  Fill  out  the  information  in  the  upper-right  hand  corner  of  Parts,  I,  II,  and 
III,  so  that  each  part  of  the  evaluation  has  identifying  information. 

2.  Part  I  can  be  administered  on  any  day  with  the  homemaker  except  when  the  aide 
is  administering  the  RSI-1. 

3.  When  administering  Part  I,  RS7:-2,  the  agent  should  request  that  the  aide  use 
a  new  recipe  with  the  homemaker. 

4.  Part  II  and  III  can  be  administered  any  time,  either  individually  or  In  a 
group . 

5.  Score  each  part  separately,  entering  the  score  in  specified  places. 

6.  Note  that  page  four  wil.l  be  fojnd  on  the  back  of  page  *^ree. 


^  BW/SM:cs.  "  10/72 

**  ^^"^         '^his  inventory  is  under  develonnent.  Do  not  duplicate  it  without  the 
mmmtm  permission  of  the  authors. 
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Number  of  visits  to  this  homemaker  by  aide 

Recipe  

Aide  

Supervising  Agent  or  Assistant   


RECIPE  SKILL  INVENTORY  •  2:    Part  I  -  for  use  by  agents  in  on-the-job  evaluation 

of  a  home  visitation  that  involves  a  recipe  preparation. 

PART  I 

A.  INSTRUCriONS :    Under  each  category,  check  those  tasks  completed  at  least  once. 

ORGANIZATION  AND  PREPARATION:    The  aide  demonstrates  behavior  of  assembling 

materials  to  indicate  planning  and  supervision  of  planning  by  homemaker. 

 ^Pre-reads  the  lesson  sheet  with  the  homemaker. 

 ^Checks  to  see  if  utensil  is  selected  or  selects  one  herself,  or  helps 

to  make  appropriate  substitution. 
 ^Has  recipe  selected  and  available  for  preparation. 

 ^Has  all  ingredients  with  her  that  the  recipe  calls  for  in  sufficient 

proportions. 

 Checks  to  see  that  the  ingredients  are  assembled  before  preparation. 

TRANSPORTING  FOOD  AND  UTENSILS:  The  aide  demonstrates  healthful  practices  in 
transporting  and  caring  for  food  and  utensils. 

 ^Stores  perishables  in  a  cooler  or  only  carries  foods  that  need  to  be 

cooled  for  a  short  period  of  time. 

 ^Keeps  utensils  in  a  clean  place  or  rinses  before  using  them^ 

 ^Keeps  lids  on  containers  of  staples  that  are  transported* 

 ^Can  easily  locate  and  extract  all  of  the  program  food  that  si^e  needs 

for  a  particular  home  visit  from  her  storage  facilities  in  her  car. 
 ^Carries  only  those  perishables  in  the  car  that  she  will  be  using  for 

one  particular  day,  and  the  rest  is  stored  in  her  home. 

B.  INSTRUCTIONS:    Check  just  ONE  of  the  following  responses  that  the  aide  is 

most  able  to  do. 

BASIC  CLEANLINESS:    The  aide's  routine  indicates  sanitary  practices. 

 ^Makes  no  attempt  to  check  for  cleanliness  in  cooking  area,  utensils 

or  her  person. 

 Some  obvious  attempt  by  the  aide  for  personal  cleanliness  and  cleanli- 
ness of  cooking  area  and  utensils* 

 puite  clean  in  person,  checks  for  cleanliness  in  food  preparation  area, 

with  utensils  and  clean-up,  but  could  use  improvement  in  one  area. 

 ^Some  attempt  made  in  all  areas — cooking  area,  utensils,  and  person. 

 ^Spotlessly  clean  in  all  aspects. 


Score 


ERLC 
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Aide   

Supervising  Agent 


PART  II 

A.     MEASUREMENl : 

1.  This  recipe  serves  2  people.    Change  the  amounts  of  the  ingredients  so 

the  recipe  will  serve  4  people.    Write  your  answers  on  the  blanks  provided. 

1  1/2  cups  leftover  meat   cup(s)  

2  tablespoons  butter   Tablespoon(s)  

3  tablespoons  flour   Tablespoon(s)  

1  cup  milk   cup(s)  

1/2  cup  leftover  peas   cup(s)  

2.  Adjust  the  same  recipe  so  it  would  serve  just  one  person.     (Divide  the 
recipe  in  half.)    Put  your  answers  on  the  space  provided. 

1  1/2  cups  leftover  meat   cup(s)  

2  tablespoons  butter   Tablespoon(s)  

3  tablespoons  flour   Tablespoon(s)  or  teaspoon(s) 

1  cup  milk   "  cup(s)  

1/2  cup  leftover  peas   cup(s)  

3.  Select  and  circle  two  of  the  following  foods  for  which  you  would  use  the 
"dip,  level,  and  pour"  method  of  measurement: 

a.    milk  d.     chopped  onions 

sugar  e.    grated  cheese 

c.    bananas  f.    baking  powder 

4.  Which  two  of  the  following  recipe?  would  demand  the  most  accurate 
measurement?    (Circle  two  recipes.) 

a.  carrot  and  raisin  salad  d.     corn-beef  dandy 

b.  Missouri  Mix  e.    oatmeal  cake 

c.  fruit  salad 

5*  If  you  needed  to  measure  2  cups  plus  2  tablespoons  of  flour,  which  of 

the  following  combinations  would  you  use:     (Use  the  KEY  to  help  understand 
the  symbols.)  y 

KEY:  -1  cup   y  0       tablespoon  .    u  teaspoon 

1.  »  »  W  ^<^C>  ^.W^  00 


6.  If  you  had  only  a  1/2  cup  measurement,  you  would  have  to  dip  and  level 

  number  of  times  to  measure  1  1/2  cups  of  flour.    (Choose  the 

right  answer  from  the  following  selection  and  circle  what  you  think  is 
correct. ) 


O  ^  a.    one  c.  three 

ERJC  b.     two  d.  four 


4. 


MEASUReiENT-SELECTION  OF  CORRECT  UTENSIL:  ^ 


in  front:  of  you  on  the  table,  you  will  see  several  measuring  utensils,  and 
you  will  notice  that  each  utensil  is  labeled  with  a  letter.    Beside  each  of 
the  following  measures,  you  are  to  write  the  letter  that  matches  the  appro- 
priate utensil.    There  may  be  more  than  one  combination  of  measurements  for 
each  blank.     Choose  only  one  combination. 


Example.     1  1/3  cups  of  flour — The  answer  is  A  &  D 

1.  ll/Z  cups  flour — The  answer  is   

2.  1  3/4  cups  sugar  —  The  answer  is   

3.  1  tablespoon  salt — The  answer  is   

4.  1/3  cup  bread  crumbs — The  answer  is   

5.  1/4  cup  lard — The  answer  is   

6.  1  ^up  milk — The  answer  is   

7.  1  teaspoon  vanilla — The  answer  is   


ABBREVIATIONS : 


1.    The  abbreviation  c.  means: 


a.  cold 

b.  cheese 

c.  cup 

2.    Ivliich  of  the  following  abbreviations  represents  a  tablespoon?  (Select  two) 


a.  tsp. 

b.  r. 

C.  'w. 

d.  rbsp. 

e .  tab . 


3.     If  you  reaa  that  a  recipe  calls  for  2  lbs.  of  meat,  this  means  you  will 
buy:     (circle  the  correct  answer.) 


a.  2  packages  c.    2  cans 

b.  1  pounds  d.    2  ounces 

4.  If  you  by  32  oz.  of  dried  beans,  that  means  you  have: 

a.  ?  lbs.  c.    2  qts. 

b.  -  c.  d.    4  tsps. 

5.  If  a  recipe  calls  for  3  oz.  of  cheese,  you  will  use: 


a.  3  handfuls  of  grated  cheese. 

b.  3  cupfuls  of  grated  cheese. 

c.  3  ounces  of  grated  cheese. 

d.  3  pounds  of  grated  chesse. 


Score   

Q  (number  correct) 


ERIC 


Aide  

Supervising  Agent 


PART  III  SAFETY  PROCEDURES 

EACH  aide  will  be  given  a  picture  which  shows  a  variety  of  kitchen  safety 
problems.    Each  aide,  on  her  own,  should  select  and  circle  in  the  picture, 
all  of  the  safety  hazards  that  she  can  find. 


Score  

(nuniber  correct) 


ANSWERS 

1.  Household  cleansers  under  sink,  within  reach  of  little  children. 

2.  Electric  outlet  overloaded. 

3.  Mother  testing  mix  with  finger  while  mixer  is  working. 

4.  Toaster  cord  dangling  over  side  of  counter,  within  reach  of  small  child. 

5.  Mother's  dress  has  wide,  floppy  sleeves  which  can  be  dangerous  at  stove. 

6.  Mother's  high  heels  a  hazard  during  houswork. 

7.  Water  on  floor  can  cause  someone  to  slip. 

8.  Wheeled  toy  on  floor  near  doorway  can  cause  a  fall. 

9.  Can  opener  juts  into  doorway. 

10.  Pot  handles  should  be  turned  toward  back  of  stove  beyond  reach  of  child. 

11.  Back  burner  lighted  without  pot  on  it. 

12.  Tea  kettle  spout  should  be  turned  toward  back  of  stove. 

13.  Mother  has  left  bottles  of  medication  on  counter  within  reach  of  child. 

14.  Scissors,  knife  and  long  fork  are  within  reach  of  small  child. 


WSU  Cooperative  Extension  Service 
Pullman,  Washington 


RECIPE  SKILL  INVENTORY 
^'  IINSTRUCTIONS:    Under  each  category,  check  those  tasks  completed  at  least  cr\cel 

3-    ORGANIZATION  AND  PREPARATION:    Demonstrates  behavior  of  assembling 
materials  to  indicate  planning . 

  sets  out  needed  utensils 

  selects  all  ingredients  in  advance  arcording  to  steps  1n  recipe 

  makes  advance  preparation  of  ingredients  (chop,  grate) 

  pre-reads  recipe 

  is  speedy  and  efficient 


b.  USE  OF  UTENSILS:    Demonstrates  ability  to  select  and  use  appropriate 
tools  for  recipe  and  to  care  for  them  properly  during  and  after  use. 

—  stores  utensils  in  clean,  dust-free  place;  or  rinses  them  before  use 

  selects  appropriate  utensil  or  can  make  substitutions 

  prepares  utensils  properly  (grease,  dust  with  flour) 

  re-uses  utensils  or  uses  few 

  cares  for  utensils  properly  after  use 


c-    USE  OF  HEAT  SOURCE:    Demonstrates  appropriate  use  of  oven  and  stove 
as  directed  by  the  recipe. 

selects  appropriate  temperature  (adjusts  for  equipment  faults,  if  necessary) 
selects  appropriate  burner 
pre-heats  oven 

locates  rack  appropriately  in  oven 
times  food  being  cooked 


d.    SAFETY  PROCEDURES:    Demonstrates  practices  in  accident  prevention,  - 

  keeps  paper  and  other  flammables  from  heat  source 

  keeps  her  clothing  from  heat  source 

  has  safety  devices  available  (hot  pads) 

  fi^s  fire  extinguisher  or  extinguishing  compound  (baking  soda)  near 

heat  source 

  places  handles  of  pots  and  pans  on  top  of  stove  pointing  inward       |  , 

n.  [INSTRUCTIONS:    Each  category  below  has  5  sentences  describing  skill  levels  | 
[of  homemakers.    Check  the  one  statement  that  best  describes  this  homemakei-.  j 


a.  ABBREVIATIONS:   Demonstrates  correct  application  of  measurements  in  recipe. 

  cannot  use  abbreviations 

  has  trouble— knows  they  represent  measurenents 

  understands  some  abbreviations  (perhaps  2) 

  seems  to  know  almost  all  of  the  abbreviations  (3  or  4) 

  can  use  all  abbreviations  accurately 


Family  Number 
Interviewer 
County  


RECIPE  SKILL  INVENTORY 


I.   IINSTRUCTIONS:    Under  each  category,  check  those  tasks  conipieted  at  least  once^ 


a.  ORGANIZATION  AND  PREPARATION:    Demonstrates  behavior  of  assembling 
materials  to  indicate  planning. 

  sets  out  needed  utensils 

  selects  all  ingredients  in  advance  according  to  steps  in  recipe 

  makes  advance  preparation  of  ingredients  (chop,  grate) 

  pre-reads  recipe 

  is  speedy  and  efficient  i  i 

b.  USE  OF  UTENSILS:    Demonstrates  ability  to  select  and  use  appropriate 
tools  for  recipe  and  to  care  for  them  properly  during  and  after  use, 

  stores  utensils  in  clean,  dust-free  place;  or  rinses  them  before  use 

  selects  appropriate  utensil  or  can  make  substitutions 

  prepares  utensils  properly  (grease,  dust  with  flour) 

  re-uses  utensils  or  uses  few 

  cares  for  utensils  properly  after  use  i  i 

c.  USE  OF  HEAT  SOURCE:    Demonstrates  appropriate  use  of  oven  and  stove 
as  directed  by  the  recipe. 

  selects  appropriate  temperature  (adjusts  for  equipment  faults,  if  necessary) 

  selects  appropriate  burner 

  pre- heats  oven 

  locates  rack  appropriately  in  oven 

  times  food  being  cooked  \  f 

d.  SAFETY  PROCEDURES:    Demonstrates  practices  in  accident  prevention. 

  keeps  paper  and  other  flammables  from  heat  source 

  keeps  ner  clothing  from  heat  source 

  has  safety  devices  available  (hot  pads) 

  has  fire  extinguisher  or  extinguishing  compound  (baking  soda)  near 

heat  source 

  places  handles  of  pots  and  pans  on  top  of  stove  pointing  inward       |  i 


IL 


INSTRUCTIONS:  Each  category  below  has  5  sentences  describing  skill  levels 
of  homemakers.    Check  the  one  statement  that  best  describes  this  homemaker. 


^-j  ABBREVIATIONS:  Demonstrates  correct  application  of  measurements  in  recipe. 
  cannot  use  abbreviations 

  las  trouble— knows  they  represent  measurements 

  understands  some  abbreviations  (perhaps  2) 

  seems  to  know  almost  all  of  the  abbreviations  (3  or  4) 

can  use  all  abbreviations  accurately  i  \ 


b.  MEASURING:    Demonstrates  correct  application  of  measurements. 

  does  NOT  measure  and  cannot  estimate  accurately 

  does  NOT  measure  but  CAN  estimate  accurately 

  measures  some  ingredients 

  measures  all  ingredients,  but  may  be  careless  and/or  wasteful 

 [  measures  all  ingredients  accurately  L 

c.  BASIC  CLEANLINESS:    Routine  indicates  sanitary  practices. 

  no  attempt  made  to  clean  cooking  area,  utensils,  or  person 

  some  obvious  attempt  made  at  cleanliness  in  at  least  one  area 

  quite  clean  in  person,  food  preparation,  utensils  and  clean-up,  but 

could  use  improvement  in  one  area 

  some  attempt  made  in  ajn[  areas— cooking  area,  utensils,  and  person 

  spotlessly  clean  in  all  aspects  /_ 

BW/SM:cs   

5/72 

**  (B-S  Z}    This  inventory  is  under  development.  TOTAL 
Do  not  duplicate  it  without  permission  of  the 
i  authors. 
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ABSTRACT 

A  few  specialized  fields  of  practice  in  adult  education  have  begun  to 
develop  standardized  tests  of  learning  outcomes  but  the  discipline  itself  has 
not  yet  done  so.  Objective  tests  might  be  useful  adjuncts  to  instruction  about 
adult  education  as  they  would  facilitate  the  determination  of  entry  and  exit 
behaviours  of  participants  in  both  credit  and  non-credit  programs  and  assist 
in  the  design  of  instruction.  This  study  reports  the  development  and  appli- 
cation of  a  test  of  knowledge  about  five  topical  areas  in  adult  education, 

A  100-item  dichotomous  choice  test  was  constructed  and  administered  to 
124  students  enrolled  in  graduate  and  undergraduate  courses  in  adult  education. 
Three  procedures  were  used  to  estimate  reliability  and  the  obtained  coefficients 
were  considered  acceptable  for  the  total  instrument,  questionable  for  four 
topical  areas,  and  poor  for  the  items  concerned  with  the  adult  learner.  The 
construct  validity  of  the  instrument  was  examined  by  relating  test  performance 
to  the  background  characteristics  of  those  completing  the  test.    The  chief 
factor  influencing  performance  was  found  to  be  the  number  of  previous  university 
courses  in  adult  education. 

The  utility  of  the  instrument  x^as  explored  in  several  credit  and  non- 
credit  programs  and  was  found  generally  to  be  a  useful  component  of  the 
instructional  process.     Significant  differences  were  noted  between  pre  and 
post  measures  in  the  majority  of  cases.    The  results  of  the  study  suggest  the 
desireability  of  developing  additional  instruments  to  measure  knowledge, 
attitudes,  and  skills  needed  for  effective  performance  in  the  discipline  and 
field  of  practice  of  adult  education. 
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INTRODUCTION 

Various  specialized  fields  of  practice  in  adult  education  have 
begun  to  develop  standardized  tests  in  order  to  assess  learning  achievement 
and  performance  by  program  participants.    This  is  particularly  evident  in 
program  areas  such  as  adult  basic  education  where  there  are  many  partici- 
pants, the  investment  is  large,  and  the  educational  objectives  may  be 
defined  clearly.  Standardized   tests  related  to  the  discipline  of  adult 
education  itsalf,  however,  are  probably  nonexistent.    As  adult  education 
is  growing  rapidly  as  a  field  of  study,  there  appears  to  be  a  need  emerging 
for  the  development  of  instruments  that  could  be  useful  in  determining  the 
level  of  appropriate  training  for  adult  education  leaders. 

This  study  first  outline*?  a  rationale  for  the  development  of 
standardized  tests  in  adult  education  and  then  describes  the  construction 
and  analysis  of  a  test  of  knowledge.    Factors  related  to  performance  on  the 
instrument  are  discussed  and  its  utility  is  explored  with  reference  to 
several  applications  of  the  test. 

RATIONALE 

The  emergence  of  adult  education  as  a  distinct  academic  discipline 
as  well  as  a  field  of  professional  practice  has  been  documented  elsewhere 
(6,  10),    The  rapid  growth  in  the  number  of  practitioncirs  engaged  in  the 
field  coupled  with  an  expansion  in  the  body  of  knowledge  about  adult  educa- 
tion has  produced  a  growing  demand  both  for  full-time  and  part-time  training 


2 


programs  pertaining  to  the  principles  and  practices  of  adult  education • 
This  demand  has  been  expressed  at  all  levels  in  the  leadership  pyramid  des- 
cribed by  Houle  (5)  which  includes  full-time  professional  adult  educators 
as  well  as  part-time  leaders  and  volunteer  workers. 

The  growing  demand  for  programs  of  preparation  in  adult  education 
has  led  to  a  number  of  problems  for  those  engaged  in  their  provision.  When 
the  demand  was  slight  and  the  number  of  students  limited,  it  was  a  relatively 
simple  matter  to  arrive  at  consensus  about  program  content  through  individual 
counselling  or  small  group  discussion  processes.    With  an  increasing  demand 
and  a  larger  number  of  students,  however,  those  services  have  become  harder 
to  provide.    Moreover,  the  body  of  knowledge  in  adult  education  was  small 
in  the  past  compared  with  the  current  volume  of  substantive  knowledge 
derived  from  I'eSedica  reliitea  to  tu6  field  50  that  there  are  now  move 
options  from  which  content  may  be  selected.    Those  factors,  together  with 
others  such  as  increasing  specialization  within  adult  education  and  restric- 
tions upon  financial  resources  for  providing  both  degree  and  non-degree 
programs,  have  compounded  the  problems  involved  in  designing  appropriate 
and  effective  learning  experiences  for  adult  education  leaders. 

Determining  rapidly  a  starting  point  for  education  and  training 
in  adult  education  for  individuals  or  groups  of  participants  is  a  crucial 
requirement  for  providing  useful  and  effective  programs  at  all  levels  of 
the  leadership  pyramid.    This  has  been  done  traditionally  by  inquiring  about 
previous  experience  in  the  field  and  by  attempting  to  identify  learning 
needs  perceived  by  the  participants.    The  design  and  conduct  of  programs 
would  be  aided  considerably,  however,  if  data  could  be  obtained  quickly 
respecting  the  entry  level  of  information  possessed  by  the  participants 


3 


in  relation  to  the  existing  body  of  knowledge  about  adult  education.  With 
such  data  in  hand,  an  instructor  would  be  able  to  adapt  the  program  content 
and  processes  to  suit  the  existing  level  of  knowledge  of  the  participants, 
Verner  £t  al_  (10)  note  that  the  development  of  valid  and  reliable  instru- 
ments to  measure  and  assess  knowledge,  skills  and  attitudes  needed  for  an 
efficient  performance  of  the  tasks  in  the  discipline  and  in  the  field  of 
adult  education  is  one  of  the  more  urgent  t.asks  for  future  research.  This 
study  explores  one  small  component  of  that  task  by  describing  the  develop- 
ment and  applicati'-'n  of  a  test  of  knowledge  about  adult  education. 

INSTRUMENT  DEVELOPMENT 

Three  principal  requirements  were  established  regarding  the  nature 
of  the  instrument  which  guided  the  stages  of  its  development.    Firstly,  the 
test  would  have  to  be  capable  of  quick  completion  and  scoring  so  that  it 
would  not  occupy  an  inordinate  amount  of  time  in  a  short  training  program. 
In  order  to  meet  this  requirement,  a  dichotomous  choice  (True  -  False) 
method  of  response  was  chosen  despite  the  known  limitations  of  that  format. 
Secondly,  the  instrument  should  be  available  in  alternate  forms  so  that  it 
could  be  used  for  entry  and  exit  assessments  enabling  the  determination  of 
change  or  learning  concurrent  with  training.    An  attempt  was  made  therefore 
to  develop  two  equivalent  forms.    Thirdly,  it  was  determined  that  the  test 
should  sample  knowledge  in  several  domains  of  adult  education  to  explore 
whether  the  testing  strategy  would  have  broad  utility.    Five  topical  areas 
commonly  included  in  adult  education  training  programs  were  therefore  in- 
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eluded  in  the  instrument;  the  adult  learner,  adult  learning  processes,  course 

planning,  adult  instruction,  and  evaluation. 

Construction 

The  test  items  were  derived  originally  from  reference  books  used 
commonly  In  adult  education  and  from  infoirmal  achievement  tests  used  in 
several  adult  education  courses,    A  pool  consisting  of  several  hundred  items 
was  developed  and  ass(^mbled  in  several  trial  versions  which  were  administered 
in  university  credit  courses  in  adult  education  as  well  as  in  non-credit  work- 
shops and  short  courses.    Item  analyses  were  conducted  after  the  administration 
of  each  test  and  those  items  with  a  difficulty  index  of  more  than  75  percent  or 
less  than  25  perct^nt  were  discarded.    Comments  about  the  quality  of  the  items 
were  sought  from  those  completing  each  test  so  that  the  items  could  be  edited 
for  clarity  and  precision. 

The  final  version  of  the  instrument  consisted  of  100  items  with  twenty 

in  each  of  the  five  topical  areas.  Each  sub-test  contained  ten  items  in  Form  1 

and  ten  in  Form  2.  All  of  the  test  items  were  in  the  knowledge  category  of  the 

cognitive  domain  analyzed  by  Bloom  (1).  Of  the  100  total  items  42  percent  were 

"True"  and  58  percent  "False"  with  at  least  40  percent  "True"  items  and  no  more 

than  60  percent  "False"  in  each  sub-test  and  group  of  ten.    The  true  and  false 

statements  were  arranged  randomly  in  order  to  avoid  the  establishment  of  response 

patterns.    The  complete  test  is  reproduced  elsewhere  (2),  but  a  representative 

item  from  each  of  the  five  topical  areas  is  sho\^m  below  for  illustrative  purposes. 

The  Adult  Learner:  The  near  point  of  vision  tends  to  move  closer 
as  age  advances. 

Adult  Learning:  Learning  to  play  golf  is  an  example  of  learning  in 
the  affective  domain. 
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Course  Planning:    An  objective  describes  a  pattern  of  behaviour 
that  the  learner  is  expected  to  demonstrate  at  the  end  of  a  course. 

Adult  Instruction:    A  lecture  should  last  for  no  more  '  lan  30 
minutes* 

Evaluation:    Test  items  used  to  measure  recognition  memory  are 
easy  to  score  but  hard  to  construct. 

Administration 

The  test  was  administered  to  all  students  participating  in  courses 
offered  by  the  Department  of  Adult  Education  of  the  University  of  British 
Columbia  in  the  1971-72  academic  year.    It  was  completed  by  a  total  of  12A 
students  during  the  first  or  second  class  meeting  in  September,  1971.  No 
time  limit  was  set  but  most  of  the  tests  were  completed  within  30  minutes. 
The  students  were  informed  that  the  test  wa'S  in  the  developmental  stage  and 
that  they  need  not  identify  themselves  by  name.    They  were  asked,  however, 
to  provide  information  about  five  background  characteristics  including  s<5x, 
age,  years  of  experience  in  adult  education,  the  number  of  university  courses 
in  adult  education  taken  previously,  and  the  number  of  short  courses  and 
workshops  about  adult  education  they  had  attended. 

Of  the  ^itudents  completing  the  test,  29.0  percent  were  enrolled  in 
graduate  courses  in  adult  education  and  71.0  percent  were  in  undergraduate 
courses.    Slightly  more  females  (53.2  percent)  than  males  (A6.8  percent) 
completed  the  test.    Males  outnumbered  females  in  graduate  courses  with  55.6 
percent  of  the  respondents  but  the  undergraduate  group  contained  56.8  per- 
cent females.    As  Table  1  indicates,  the  graduate  students  averaged  36.2 
» 

years  of  age  compared  to  26.7  years  for  the  undergraduates.    The  students 
enrolled  in  graduate  courses  reported  more  years  of  experience  in  adult 


6 


ERIC 


Table  1 

Characteristics  of  Graduate  and  Unaergraduate 
Students  who  Completed  the  Test 


Characteristics 


Undergraduate 
Students 
(N«88) 
Mean  S.D. 


Graduate 
Students 
(N^36) 
Mean  S.D. 


Total 
(N=124) 
Mean  S.D, 


Age  26.7  7.20 

Years  experience  in 

adult  education  0.7  2.13 

Previous  university  courses 

in  adult  education  0.0  0.00 

Previous  short  courses  in 

adult  education  0.6  1.76 


36.2       8.88  29.5  8.83 


4.1        4.27  1.7  3.29 


1.4         2.10  0.4  1.29 


1.6        1.89  0.8  1.85 
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education,  a  higher  average  number  of  previous  university  courses  in  adult 
education,  and  greater  participation  in  short  courses  and  workshops  about 
adult  education  than  was  reported  by  the  undergraduate  students. 
Results 

The  results  obtained  by  the  124  students  in  adult  education  courses 
who  completed  the  test  are  summarized  in  Table  2,    The  mean  total  score  on 
the  100  items  was  64.3  with  a  standard  deviation  of  9.00  and  a  range 
from  29  to  94.    The  mean  total  scores  for  the  two  forms  were  similar  as  th'" 
students  averaged  32,4  on  Form  i  and  31,9  on  Form  2.    Scores  for  the  twenty 
items  in  each  of  the  five  topical  areas  ranged  from  11.4  fo"^  the  evaluation 
items  to  14.1  for  the  adult  learning  section.    No  group  of  ten  items  had  an 
average  score  less  than  5,5  and  none  was  greater  than  7,7 •    The  sub-test 
Rpction  anH  form  fof^ls  rorrpl;^tpd  signi f  i  c^intly  wi  th  the  total  test  score 
with  coefficients  higher  than  .60  in  most  cases,  although  the  adult  learner 
sub-test  showed  a  lower  correlation  coefficient  in  relation  to  total  test 
score  than  did  the  other  sub-totals . 
Reliability 

Reliability  of  the  five  sub-tests  and  the  total  test  was  estimated 
using  three  methods;  correlation  between  forms,  the  Spearman-Brown  prophesy 
formula,  and  the  Kuder-Richardson  Formula  21.   (Table  3)    The  results  ob- 
tained from  the  correlation  between  forms,  which  provides  a  coefficient  of 
equivalence  (3) ,  indicated  that  the  adult  learner  sub-test  was  not  reliable 
but  coefficients  for  four  of  the  topical  areas  ranged  from  .43  to  .52. 
The  reliability  coefficient  for  the  two  forms  of  the  full  test  was  ,71. 


Table  2 


Means,  Standard  Deviations,  and  Correlation  with 
Total  Test  Score  for  Sub-Tests 


Correlation 

Mean  with 
Sub-Test  (N=124)  S.D.  Total  Score 


The  Adult  Learner 
Form  1 
Form  2 
Sub-total 


7.7 
5.9 
13.6 


1.31 
1.43 
2.02 


.41 
.37 
.53 


Adult  Learning 
Form  1 
Form  2 
Sub-total 


6.6 
7.5 
14.1 


1.43 
1.58 
2.55 


.62 
.64 
.75 


Course  Planning 
Form  1 
Form  2 
Sub-LuLal 


6.2 
6.8 


1.41 
1.71 


.60 

.67': 

.74 


Adult  Instruction 
Form  1 
Form  2 
Sub-total 


6.0 
6.2 
12.2 


1.53 
1.51 
2.65 


.64 
.60 
.71 


Evaluation 
Form  1 
Form  2 
Sub-total 


5.9 
5.5 
11.4 


1.71 
1.60 
2.86 


.61 
.65 

.73 


Total  Score 
Form  1 
Form  2 
Total 


32.4 
31.9 
64.3 


4.67 
5.00 
9.00 
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Table  3 

Reliability  Coefficients  for  Sub-Test  and 
Total  Test  Scores 


Sub-Test 

Correlation 
Between 
Fonns 

Spearman- 
Brown 

KR  21 

The  Adult  Learner 

.08 

.14 

.07 

Adult  Learning 

.43 

.60 

.36 

Course  Planning 

.43 

.60 

.38 

Adult  Instruction 

.52 

.69 

.32 

Evaluation 

.48 

.65 

.40 

Total 

.71 

.83 

.72 

ERJC 
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Application  of  the  Spearman-Brown  formula  suggested  that  doubling  the  length 
of  the  test  would  increase  the  reliability  of  four  sub-tests  into  the  ,60 
to  .69  range  and  would  increase  the  coefficient  for  .the  full  trst  to  .83. 
The  Kuder-Richardson  Formula  21,  which  provides  a  conservative  estimate  of 
reliability  (4),  produced  reliability  coefficients  of  .32  to  ,40  for  four 
sub-tests  and  an  overall  coefficient  of  •72,    In  general,  the  obtained 
reliability  coefficients  were  within  an  acceptable  range  for  the  total  test 
but  questionable  for  four  of  the  sub-tests.    The  sub-test    concerned  with 
the  adult  learner  produced  such  low  reliability  coefficients  that  it  was 
judged  not  reliable. 


FACTORS  ASSOCIATED  WITH  TEST  PERFORMANCE 


The  construct  validity  of  the  test  was  examined  by  relating  test 
performance  with  the  background  characteristics  of  the  studerts  who  completed 
the  instrument.    This  part  of  the  study  was  guided  by  three  hypotheses 
regarding  the  nature  of  the  relationship  between  test  scores  and  student 
background  In  the  discipline  of  adult  education  and  in  the  field  of  practice. 
It  was  hypothesized  that: 

1.  Students  who  had  received  more  previous  training  in  the 
discipline  of  adult  education  would  obtain  higher  scores 
on  a  test  of  knowledge  about  adult  education  than  would 
those  with  less  training. 

2.  Students  with  more  experience  in  the  field  of  practice  of 
adult  education  would  obtain  higher  scores  on  a  test  of 
knowledge  about  adult  education  than  would  those  with  less 
experience. 
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Since  the  test  was  based  on  knowledge  that  would  most  likely  be  learned  *n  a 
formal  instructional  setting  designed  to  facilitate  learning  about  the  :;ontent 
of  the  discipline  rather  than  on  information  that  would  ncrmally  be  learned  in 
the  job  experiences  encountered  in  the  field  of  practice,  it  was  further 

hypothesized  that : 

3*  Factors  associated  with  training  in  adult  education  would  be  more 
closely  related  to  test  performance  than  would  factors  associated 
with  experience  in  the  field. 

Variables  pertaining  to  experience  in  the  field  of  practice  included  age 
and  years  of  experience  while  enrollment  in  graduate  or  undergraduate  courses, 
participation  in  previous  university  courses  in  adult  education,  and  attendance 
at  short  courses  represented  training  in  the  discipline.    The  stated  hypotheses 
were  tested  using  zero-order  correlation  co  fficients  and  multiple  regression 
analysis* 

The  results  of  the  analyses  tended  to  support  the  first  and  thtra 
tiy potli^Gses  but  not  the  second  •    As  Table  A  xtidxcates ,  tlte  nuuiber  cf  previous 
university  courses  was  the  only  variable  showing  a  significant  association  with 
the  total  test  score  at  the  ,01  level  (r=,39)  while  the  number  of  short  courses 
attended  (r=.18)  and  age  (r=.20)  were  related  to  the  total  score  for  all  stu- 
dents at  the  .05  level  of  significance.    When  undergraduate  and  graduate 
students  were  analyzed  separately,  none  of  the  background  factors  produced 
significant  correlation  coefficients  with  total  test  score  in  the  undergraduate 
group  but  previous  university  courses  in  adult  education  was  associated  with 
test  performance  (r=.39,  p  ^.05)  in  tha  graduate  group.    A  multiple  regression 
analysis  for  all  students  using  total  test  score  as  the  dependent  variable 
showed  that  16.3  percent  of  the  variation  in  scores  was  accounted  for  by  the 
background  characteristics  of  the  students  with  the  number  of  previous  univer- 
sity courses  in  adult  education  emerging  as  the  only  independent  variable  with 
an  F  probability  less  than  .05. 
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Table 

Zero-order  Correlation 
Total  Test  Score  and 


4 

Coefficients  between 
Selected  Variables 


Undergradu.-^te  Graduate  Total 

Students  ^  Students  Students 

Variables  .(N=88)  (N=36)  (N=124) 


Age  —.09  .20  .20* 

Years  Experience  in 

Adult  Education  — .16  .17  .17 

Previous  Courses  in 

Adult  Education  .00  .39*  .39** 

Short  Courses  in 

Adult  Education  .07  .18  .18* 


*  p  <  .05 
**  p  <  .01 
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The  total  instrument  appeared  to  possess  some  degree  of  construct 
validity  in  that  more  previous  training  in  adult  education  was  reflected  in 
a  higher  test  score.    Experience  in  the  field  of  practice,  however,  v/as  not 
related  to  test  performance.    This  suggests  that  the  instrument  might  be  a 
useful  index  of  knowledge  about  adult  education  generally  but  can  not  be  used 
in  any  way  as  an  indicator  of  performance  in  the  field  of  practice. 

UTILITY  OF  THE  INSTRUMENT 

The  utility  of  the  test  of  knowledge  about  adult  education  was 
e/.plored  in  several  university  credit  courses  and  in  non-credit  workshops 
and  short  courses  offered  in  the  community.    The  first  section  of  the  test 
concerning  the  adult  learner  was  discarded  because  of  its  low  reliability 
while  the  remaining  four  sections  were  assembled  in  two  alternate  forms  of 
40  items  for  use  as  pre  and  post  assessment  devices.    The  tests  served  three 
principal  functions  in  the  situations  in  which  they  were  used. 

1.  They  provided  feedback  to  the  participants  about  their  learning 
performance  during  training. 

2.  They  provided  the  instructor  with  an  index  of  his  instructional 
effectiveness. 

3.  They  enabled  the  instructor  to  demonstrate  and  explain  a  system- 
atic approach  to  adult  instruction. 

Data  respecting  test  performance  were  obtained  from  four  groups 

totalling  101  participants.    Two  instructors  each  taught  two  groups 

which  met  for  two  hours  per  week  over  a  period  of  time  ranging  from  five  weeks 

to  six  months.    Test  scores  were  analyzed  using  the  Wilcoxon  matched-pairs 


14 


signed-ranks  test  which  considers  both  the  magnitude  and  direction  of  the 
difference  between  pairs  of  scores  (8),    As  Table  5  shows,  pre-test  total 
scores  in  the  four  groups  ranged  from  a  mean  of  22,4  to  24,5  out  of  40  while 
the  post-test  mean  totals  varied  from  27 ,6  to  30, 9,     In  every  case  the  post- 
test  mean  was  significantly  greater  than  the  pre-test  mean  with  respect  to 
the  total  score,  but  five  of  the  sixteen  sub-tests  did  not  show  a  significant 
gain.     In  three  of  those  sub-tests  where  no  significant  change  occurred,  no 
instruction  had  been  given  on  that  topic.    The  results  obtained  from  the 
administrations  of  the  pre  and  post  tests  provide  some  additional  evidence 
of  construct  validity  in  that  there  was  a  significant  change  in  test  per- 
formance concurrent  with  training. 


CONCLUSION 


The  development  and  application  of  a  test  of  knowledge  about  adult 
education  described  in  this  study  suggests  that  it  is  both  possible  and  use- 
ful to  construct  reliable  and  valid  instruments  related  to  the  discipline. 
The  process  described  herein,  however,  needs  to  be  extended  into  other 
topical  areas,  additional  levels  of  the  cognitive  domain  of  learning,  and 
more  sophisticated  types  of  instruments.    It  may  be  possible  ultimately  to 
construct  standarized  instruments  covering  the  full  scope  of  the  discipline 
of  adult  education,  but  this  would  depend  to  a  considerable  extent  upon  the 
further  codification  and  organization  of  the  body  of  knowledge  pertaining  to 
the  education  of  adults.    The  conceptual  scheme  presented  by  Verner  (9)  and 
the  concept  analysis  suggested  by  Leagans,  Copeland,  and  Kaiser  (7),  for 
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example,  are  useful  steps  in  this  direction  in  that  they  attempt  to  organize 
the  discipline  in  ways  that  would  be  amenable  to  the  development  of  eval- 
uative instruments. 

The  further  development  of  cognitive  testing  should  yield  considerable 
benefits  to  those  engaged  in  the  provision  of  training  for  adult  education 
leaders,  but  it  still  leaves  untouched  the  perplexing  problems  of  identifying 
and  measuring  attitudes  and  skills  necessary  for  effective  performance  in  the 
field  of  practice  and  the  assessment  of  performance  itself.    The  development 
of  valid  and  reliable  measures  in  those  areas  is  a  task  that  would  require  a 
concentrated  research  effort  by  those  concerned  with  the  preparation  of  adult 
educators* 
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Introduction 


Tbe  contribution  which  learning  theories  can  irake  to  improve 
classrooF.  Instruction  and  to  generate  ov^aningful  research  is  indeed  a 
very  debatable  topic.    Educators  who  arc  critical  of  the  inputs  of 
psychologists  often  claim,  and  sometimes  Justifieibly  so,  that  when  one 
Weeds  through  the  mass  of  technical  jargon,  one  is  left  with  a  handful 
of  common  sense  notions  which  one  was  cognizant  of  before  beginning  the 
ordeal.    Yet,  if  a  comprehensive  theory  of  learning  exists  which  is 
applicable  to  adults,  it  would  be  of  great  utility  for  both  researchers 
and  instructors.    It  would  enable  educators  to  summarize  the  existing 
data  concerning  the  processes  by  which  adults  learn.    Furthermore,  it 
could  be  used  to  generate  studies  to  determine  the  extent  to  which  differ- 
ing approaches  to  learning  facilitate  growth  in  cognitive  and  affective 
domains.    From  the  standpoint  of  the  adu.lt*  instructor,  a  comprehensive 
learning  model  would  afford  the  teacher  an  opportxmity  to  formtxlate  a 
workable  rationale  for  instruction. 

At  present,  no  single  learning  theory  is  applicable  in  all  educa- 
tional settings.    Since  this  state  of  affairs  is  likely  to  continue  for 
some  time,  our  only  altemat^ive,  from  a  pragmatic  standpoint,  is  to 
delineate  and  to  compeure  the  inqpli cations  of  current  varioxis  learning 
approaches.    While  a  comparison  of  the  learning  models  will  be  under- 
taken in  this  paper,  it  should  not  be  misconstrued  as  representing  an 
evaluation.    The  authors  have  deliberately  chosen  hot  to  evaluate  them. 
Each  reader  must  decide  for  himself  ^ich  approach  will  afford  him  a 


fruitful  theoretical  base  for  adxat  instructioa  or  to  formulate  research 
projects  of  ad\ilt  learning.    In  a  somewhat  similar  vein,  each  instructor 
must  decide  for  himself  which  aspects  of  the  various  theories  he  adheres 
to»  and  synthesize  them  into  a  rationale  which  he  can  subsequently 
utilize  aa  a  guide  to  his  own  Instructional  undertakings. 

In  oraer  to  set  the  stage  for  enumerating  the  implications  of  each 
learning  theory  as  well  as  for  their  comparison,  a  brief  description 
follows  of  the  principal  points  of  the  learning  theories  and  of  several 
prominent  leasming  models. 


OVERVIEW  OF  LEARNING  THEORIES* 


The  positions  which  are  currently  adhei^d  to  emong  learning  theorists 
can  be  divided  into  the  following  three  principal  orientations:  (a^ 
Behaviorism;  Behaviorists  concern  themselves  with  the  observables  of 
behavior,  namely  stimuli  and  rt^sponses.    Strict  behavioristic  doctrine 
avoids  any  speculation  about  what  is  going  on  in  the  mind,  (o)  Neo-Behav- 
iorism:  Neo-Behaviorists  also  include    stimuli  and  responses  as  che  only 
valid  indicators  of  behavior,  but  they  also  consider  \rtiat  happens  between 
the  input  of  stimuli  and  the  output  of  responses  in  terms  of  mediational 
processes,    (c)  Cognitivism:  Cognitive  psychologists  deal  with  man  as  a 
rule  forming  being  and  the  cognitive  structure  of  the  individualL  is 
considered  to  be  of  paramount  inq^^ortance  for  learning. 


*This  section  of  the  paper  as  well  as  the  last  section  have  been  adapted 
from  Le  Francois  (1972). 


SELECTTED  LEARimiG  THEORIES  APPROPRIATE  FOR  ADULT  INSTRUCTION 


In  this  section,  eight  learning  theories  and  three  technologies 
of  instruction  will  be  described.    The  iaqplications  of  each  theory 
for  adult  instruction  will  be  indicated. 

Skinner »  B.F*    (operant  learning) 

Skinner  (l938,  1953,  1958)  deals  chiefly  vith  those  behaviors 
which  are  NOT  evoked  by  any  known  st^uli  bu^  which  are  simply  emitted 
by  the  organism.       Thus,  he  is  focusing  on  the  link  formed  between  the 
response  and  the  reinforcement*    Stimuli  function  to  mark  the  occasion 
upon  which  the  behavior  can  or  will  occur.    When  stimuli  act  in  such 
a  fashion,  they  are  known  as  discriminative  stimuli.    Skinner *s  operant 
learning  model  can  be  presented  as  follows: 

Operant  Learning  Model 

1.  Response   y  Rewaard  and  s'^ 

2.  S^  I-   — Response 

(S^  -  discriminant  stimulus) 

Specific  Implications  of  Skinner's  Theory  for  Adult  Instruction 

Most  of  the  impl' nations  of  Skinner's  theory  deal  with  the  necess- 
ary arrangement  of  stimuli  and  responses  for  modifying  behavior. 
Behavior  modification  techniques  are  ciorently  being  used  to  change 
behavior  is  a  multitude  of  contexts  including:  (a)  employer-employee 
relations,  (b)  study  habits  of  students,  (c)  training  of  nurses  and 


(d)  behavior  therapy*    Skinner  points  out  that  in  the  early  stages  of 
training  it  is  essential  to  reinforce  every  desired  response  and  to  do 
so  immediately  following  the  responses*    Once  learning  has  proceeded 
as  expected,  the  schediile  of  reinforcement  may  be  changed  to  a  variable 
ratio  schediae.    He  also  notes  that  great  care  must  be  taken  to  develop 
an  appropriate  arrangement  of  the  desired  responses*    The  establishment 
of  convenient  secondary  reinforcers  is  ciso  a  necessity  becaixse  of 
the  numerous  limitations  on  having  to  always  provide  an  individual  with 
primary  reinforcement.    With  regard  to  the  elimination  of  undesirable 
responses.    Skinner  advocates  that  the  most  effective  method  i.j  to  NOT 
reinforce  the  response  rat.  ^  than  to  punish  the  individual  for  making 
the  response.    Since  Skinner  views  the  teacher  as  the  arranger  of 
stimuli,  he  feels  that  the  instmctor  must  share  the  responsibility 
for  the  responses  of  the  students. 

Hull^  C.  (drive  reduction) 

Hull  (19U3)  developed  a  set  of  postulates  in  order  to  build  a 
general  theory  of  behavior.    Drive  reduction  is  an  essential  component 
of  his  theory.    He  believed  performance  was  a  function  of  drive, 
reinforced  practice,  incentive,  and  intensity  of  the  stimulus.  Further- 
more, he  believed  that  inhibition  of  responses  occurred  with  too  fre- 
quent use  and  that  this  inhibition  itself  could  be  conditioned. 

Specific  Implications  of  Hull^s  Theory  for  Adult  Instruction 

While  Hull's  theory  wets  not  directly  concerned  with  education. 


his  theorizing  is  still  relevant.    He  maintains  that  the  first  step 
in  learning  is  to  identify  and  eliminate  competitive  responses.  These 
responses  are  tendencies  to  react  which  an  instructor  voiild  consider 
inappropriate.    Furthermore,  the  teacher  should  not  be  content  with 
teaching  one  solution  to  a  problem  but  instead,  whenever  possible, 
should  introduce  a  variety  of  techniques  for  solving  problems.  Learning^ 
for  Hull,  involved  a  rearrangement  of  responses  within  a  habit-family 
hierarchy  such  that  when  the  individual  is  presented  with  a  stimulus, 
the  •correct*  answer  is  the  most  dominant  member  of  that  particxilar 
habit-family  hierarchy.    He  also  pointed  out  the  iinportance  of  deter- 
mining the  relative  need  for  practice  at  each  step  in  a  sequential  act 
and  implementing  differential  practice  until  all  parts  of  the  task 
are  equally  well  learned. 

Hebb^  D.     (neixro-physiological  model) 

Hebb  (19^*9 )  attempt*?  to  explain  the  processes  that  intervene 
between  stimuli  and  responses  by  utilizing  neurological  hypotheses. 
The  basic  tenent  of  his  theory  is  that  mediation  (activity  between 
input  of  a  stimulus  and  output  of  response)  consists  of  activity  in 
a  group  of  nerve  cells  known  as  a  cell  assembly.    Whenever  there  is 
activity  in  a  group  of  cell  assemblies  labeled  phase  sequences,  then 
mediation  is  presumed  to  occur  also*    The  implication  of  Hebb's  work 
rfor  adult  learning  involves  capitalizing  on  the  previous  experiences 
of  the  adults  who  have  a  iqyriad  of  experiences  at  their  disposal  when 
attempt  is  being  made  to  teach  new  tasks. 
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Specific  Implications  of  Hebb's  Theory  for  Adult  Instruction 

From  Hebb's  theory  it  is  clear  that  it  is  necessary  for  the 
individual  to  have  the  relevant  sensory  experiences  in  order  to 
succeed  at  scholastic  tasks.    It  also  follows  that  when  the  background 
is  lacking  to  insure  adequate  achievement  the  first  job  of  the  instructor 
is  to  have  the  individual  engage  in  experiences  which  will  provide  him 
with  the  necessary  prerequisite  information  or  skills*    He  also  implies 
that  the  instructor  should  analyze  a  skill  or  lesson  into  its  component 
pairts  and  teach  each  one  separately.    Furthermore,  the  training  of 
learners  in  the  use  of  mediational  devices,  whenever  possible,  is  a 
worthwhile  strategy  which  can  aid  the  learner *b  progress. 

Bandura^  A.    (social  learning) 

One  of  the  fundamental  means  by  which  new  modes  of  behavior  are 
acquired  and  existing  patterns  are  modified  is       observational  learning. 
This  type  of  learning  may  be  involved  in  behaviors  ranging  from  learning 
to  talk  to  hijacking  airplanes.    Observational  learning  is  then  concerned 
with  learning  by  imitation  of  a  model.    Bandura  (1969)  contends  that  we 
learn  to  imitate  because  we  are  reinforced  for  such  behavior.  Further- 
more, through  mediational  processes  people  can  "imagine"  reinforcement 
consequences  and  the  behavior  of  models  without  experiencing  them 
directly  (vicariously). 

There  are  three  implications  of  this  theoretical  framework  for 
adults;  (l)  a  teacher  may  be  thought  of  as  a  model  which  will  influence 
the  behavior  of  his  students*    Also  the  modrl  does  not  necessarily  have 
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to  be  an  older  individual  or  one  who  is  specifically  involved  in  the 
same  field  of  interest*  (2)  a  model  may  not  be  an  actual  person  but 
rather  books,  pictures,  and  films.  These  latter  models  are  referred 
to  as  symbolic  nxDdels.  (3)  modeling  techniques  may  be  useful  in  the 
alteration  of  attitudes.  Exposure  to  a  series  of  models  who  are  held 
in  higL  '  z.zeem  moo^  lead  to  a  change  in  attitude* 

Implications  of  Bandura's  Theoiy  for  Adult  Instruction 

Bandura  believes  that  a  person  can  acquire  skills,  knowledge, 
and  attitudes  without  being  directly  involved  in  the  learning  process* 
He  feels  that  we  often  leam  by  watching  others*    Therefore,  it  becomes 
necessary  to  expose  the  individuals  to  a  wide  range  of  alternatives 
which  woxild  include  opinions,  attitudes,  philosophies,  and  people, 
so  that  they  can  decide  for  themselves  who  would  be  a  suitable  model*. 
The  instructor  should  use  the  wide  array  of  symbolic  models  at  his 
disposal  because  they  can  be  very  effective.    Social  learning  can  be 
used  to  modify  behavior  in  the  following  conterts:  (a)  clinical  settings, 
(b)  employer-employee  relations,  (c)  acquisition  of  skills,  and  (d) 
changing  of  attitudes*    An  example  of  social  learning  is  the  employee 
who  aspires  to  ingratiate  himself  with  his  boss.    A  common  tactic  in 
such  a  situation  is  to  imitate  the  dress,  mannerisms,  and  behaviors 
of  the  employer, which  essentially  represents  modelling  behavior. 

Gagne,  R*M.    (learning  systems) 


Gagne  (1965)  is  concerned  with  the  management  of  the  conditions  of 


learning.    He  has  developed  a  hierarchical  conceptualization  of  eight 
different  types  of  learning  ranging  from  S-R  bonds  to  problem  solving. 
He  believes  that  one  cannot  master  more  complex  material  learning  tasks 
until  the  fundamental  elements  have  been  learned.    For  example »  one 
cannot  learn  to  respond  to  things  or  elements  as  a  class  (concept 
learning)  until  one  can  distinguish  those  objects  vhich  are  an  instance 
of  the  class  from  those  which  are  not  (discrimination  learning). 
Therefore it  can  be  concluded  that  Gagne  is  opting  for  implementation 
of  task  analysis  procedures. 

Gagn/  (1968)  has  indicated  that  a  system  of  adult  learning  should 
differ  from  a  system  of  learning  for  children  in  terms  of  (a)  acquir- 
ing basic  skills,  (b)  organizing  knowledge,  and  (c)  stimulating  pro- 
ductive thinking. 

Specific  Implications  of  Gagne 's  Theory  for  Adult  Instruction 

Gagne'^ points  out  the  importance  of  doing  a  task  analysis.  This 
is  necessary  so  that  the  instructional  sequence  parallels  the  hierarchy 
of  knowledge  in  any  given  area.    His  eight  types  of  learning  delineate 
the  importance  of  simple  associations  for  the  development  of  more 
complex  learning  abilities.    He  also  points  out  the  need  for  a  wide 
variety  of  experience    that  enhances  the  mediational  capabilities  of 
the  individual  which  can  then  become  essential  in  problem  solving  and  concept 
types  of  learning  commonly  associated  with  cognition.    Gagne  also 
advocates  that  instructional  objectives  be  specified  for  each  unit  of 
instruction.    He  also  recommends  that  each  learning  situation  be  ass- 
essed by  informal  discussion  and  formal  tests  modes.    This  represents 
an  impoirtant  source  of  feedback  for  the  instructor  as  well  as  the  learner. 
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Bruner^  J.    (discovery  leaialng) 


Brxmer  (1966)  asstunes  that  whenever  we  interact  with  the  world 
we  utilize  categories*    Categories  are  formed  and  used  in  such  processes 
as  perception 9  decision  making,  and  conceptualization*    The  arrangeraent 
of  related  categories  to  hierarchies  is  referred  to  as  a  coding  system. 
The  most  generic  category  is  placed  on  top  (i.e»,  learning  occurs  via 
the  inductive  process)  whereas  specific  categories  form  the  base.  Cate- 
gorization is  assumed  to  reduce  the  complexity  of  the  environment, 
making  possible  the  recognition  of  objectives ,  to  eliminate  the  necessity 
for  constant  learning,  and  to  permit  the  individual  to  go  beyond  the 
information  provided.    Based  upon  his  theoretical  framework,  Bruner 
(1966)  advocates  the  use  of  a  discovery  approach  in  schools.  Discovery 
learning  occurs  when  the  student  is  not  presented  with  subject  matter 
in  its  final  form,  but  rather  is  required  to  organize  it  himself  • 

Specific  Implications  of  Bruner 's  Theory  for  Adult  Instruction 

Bruner  advocates  an  inductive  approach  to  learning;  that  is, the 
learner  builds  from  specific  categories  to  generic  codes  which  form  a 
coding  system.    It  follows  intxiitively  that  the  function  of  generic 
codes  is  dependent  on  training  in  diverse  situations  which  leads  to  the 
development  of  larger  categories  and  increases  the  classifing  ability  of 
the  learner.    With  regard  to  the  sequence  of  instruction,  he  feels  that  we 
should  present  material  which  progresses  from  being  based  on  motoric  pro- 
cesses to  iconic  processes,  and  finally  to  symbolic  processes,  Bruner 
also  feels  that  educated  guessing  should  be  encouraged  and  that  a  spiral 
ciirriculm  is  the  most  effective  means  of  arranging  material  for  the  learner, 
who  should  be  assiuoing  more  responsibility  for  learning  as  his  knowledge  grows. 
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Ausubel,  T>.    (reception  learning) 

Ausubel  (1968)  has  developed  an  expository  approach  to  instruction 
in  which  cognitive  structure  is  the  central  construct.  Cognitive 
structure  consists  of  more  or  less  organized  and  stable  concepts  (ideas) 
which  are  embedded  in  the  learner's  mind.    Ausubel  introduces  the  notion 
called  subsumer  to  define  a  concept  or  an  idea  which  includes  other 
ideas  and  concepts.    Subsumption  is  said  to  occur  when  meaningful 
material  is  incorporated  into  the  cognitive  structure.    Learning  then 
occurs  when  material  is  derived  from  preexisting  structure  and  when 
material  which  is  an  extension  of  previous  knowledge  is  involved. 
Forgetting  occurs  when  material  is  no  longer  dissociable.  According 
to  Ausubel,  one  of  the  key  variables  involved  in  meaningful  learning 
is  how  the  material  is  organized.    An  advanced  organizer    is  a  complex 
set  of  ideas  or  concepts  that  is  given  to  the*  learner  before  the  material 
is  presented. 

Specific  Implications  of  Ausubel's  Theory  for  Adult  Instruction 

According  to  Ausubel,  the  teacher  must  organize  material  in  a 
form  which  will  be  meaningful  to  the  students.    In  order  to  accomplish 
this,  the  teacher  should  use  various  kinds  of  organizers.    He  also 
emphasizes  the  need  for  the  ''.earner  to  possess  the  proper  cognitive 
structure  prior  to  the  commencement  of  the  new  material.    This  involves 
assessment  of  the  cognitive  structure  and  preparation  by  the  learner 
whenever  it  is  deemed  necessary  by  the  instructor.    He  also  points 
out  that  teaching  which  highlights  similarities  and  differences  between 
new  and  recently  learned  material  will  lead  to  greater  retention • 


Ausubel  advocates  a  deductive  model  for  instruction  which  involves 
starting  with  a  global  approach  and  then  integrating  specifics.  Journal 
articles  represent  an  illustration  of  this  approach.    The  abstract 
preceeding  the  research  article  can  be  viewed  as  a  kind  of  organizer 
for  the  reader  who  then  proceeds  to  read  the  detailed  specifics  of  the 
article. 

Rogers,  C.     (self  directed  learning) 

The  humanistic  viewpoint  states  that  an  individual's  real  world 
is  his  phenonmenal  world  (what  he  perceives)  and  thus  he,  alone,  can 
fully  know  it.    Maslow  (195^*)  contends  that  self-actualization  is  the 
last  need  to  be  met  in  a  hierarchy  of  needs  which  he  has  proposed. 
Rogers  (1969)  contends  that  man  acts  purposively  with  his  basic  ten- 
dency being  to  actualize,  maintain,  and  enhance  the  experiencing  organism. 
Based  upon  his  philosophy  and  theorizing,  Rogers  supports  student- 
centered  teaching  in  which  the  role  of  the  instructor  is  facilitating 
learning.    Such  a  technique,  however,  will  work  only  with  individuals 
who  already  have  complex  and  flexible  minds.    This  too  is  implied  in 
Maslow' s  hierarchy  of  needs;  if  the  individual  does  not  have  his  basic 
needs  met,  he  will  never  be  ready  or  able  to  self-actualize.    The  role 
of  the  teacher,  as  conceptualized  by  Rogers,  involves  being  a  good 
listener  and  interacting  in  a  genuine,  accepting,  and  empathetic  manner 
with  the  learner. 

Specific  Implications  of  Rogers'  Theory  for  Adult  Instruction 

The  instructor  must  listen  to  students  and  convey  a  sense  of  truly 


being  interested  in  what  they  say.    Purthermore ,  by  paraphrasing  the 
statement  made  by  the  students,  the  instructor  indicates  an  \mderstaading 
of  what  has  been  said  and  facilitates  communication  between  the  other 
students.    Rogers  also  indicates  that  individual  differences  shotild 
be  welcomed  and  cultiored  in  order  to  maximize  the  creativity  of  the 
individual.    He  also  feels  that  students  should  share  the  responsibility 
for  the  content  and  format  of  the  course  and  that  the  development  of 
self-evaluative  individuals  is  a  primary  goal  of  education.  This 
involves  letting  the  student  participate  actively  in  the  ongoing  eval- 
uative process.    Furthermore,  criticism  by  the  instructor  should  be 
constructive  and  meaningful  so  that  it  permits  the  student  to  grow. 


Harvey.  O.J.^  Hunt,  P..  and  Schroder.  H.     (conceptual  systems) 
Theory  of  Personality  Development 

Harvey,  Hunt,  and  Schroder  (1961 )  propose  a  developmental  theory 
of  personality  which  has  relevance  for  adult  instruction.  According 
to  their  conceptual  systems  approach,  their  best  procedure  for  inducing 
individuals  to  progress  towards  greater  complexity  and  flexibility  is 
to  match  the  stage  of  personality  development  with  the  training  environ- 
ment.   In  order  for  the  training  environment  to  increase  flexibility 
and  complexity,  it  must  extend  the  individual's  current  mode  of  behavior 
without  demanding  too  much  from  the  party.    If  we  look  at  the  class- 
room, we  can  specify  at  least  three  features  which  are  relevant:  (l) 
teacher,  (2)  students,  and  (3)  methods  of  instruction.    These  three 
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featurea  can  greatly  affect  the  learning  process  when  ve  look 
interaction. 


at  their 


Miller.  G.    (curriculum  Paradipm) 


Miller  (1967)  has  proposed  a  model  for  the  continuing  education 
of  physicians  which  can  he  readily  transfered  to  the  continuing  edu- 
cation of  aU  adults.    He  makes  an  eloquent  plea  for  changing  the  focal 
point  of  curriculum  from  the  traditional  content  model  to  a  process 
model.    In  the  content  model,  the  subject  matter  is  broken  down  into 
specific,  strucoured  material.    After  the  material  is  presented,  the 
instructor  hopes  the  learner  can  apply  what  he  has  learned.    Such  a 
model  has  failed  to  yield  the  desired  results ,  according  to  Miller. 
Instead,  he  opts  for  the  process  model  in  vhich  the  learner  engages 
in  continviing  self-education. 
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Pubin.  S.S.    (updating  model) 

A  model  has  been  produced  by  Dubin  (1972)  and  Dubln  and  Cohen  (1970) 
to  account  for  the  psychological  and  work  environmental  factors  affect- 
ing updating.    Their  model  utilizes  a  hierarchlal  dual-factor  approach 
Involving:  (l)  motivation  and  (2)  organizational  work  climate.  The 
motivational  factor  is  the  key  component  of  the  model.    McClelland  and 
Winter's  (1969)  theory  of  achievement  motivation  is  also  relevant  beca 
because  individuals  who  are  highly  motivated  concern  themselves  with 


activities  that  require  skill  and  excellence  in  perfoniiaL.je*  By  definition 
achievement  refers  to  competition  vith  a  standard. 

The  second  factor  proposed  by  Dubin  aiid  Cohen  is  organizational 
climate  which  ci^xn  he  thought  of  as  a  multidimensional  factor,  compris- 
ing five  components:  {l)  organizational  practices,  (2)  supervisory 
behavior,  (3)  on-the-job  problem  solving,  (U)  colleague  interactions » 
and  (5)  management  philosophy. 

Comparison  Amoacc  Learning  Models 

In  order  to  facilitate  the  comparison  of  the  learning  theories 
discussed  in  this  paper,  two  tables  were  constructed.    Table  1  presents 
a  descriptive  comparison  of  the  theories  in  terms  of  (l)  orientation, 
(2)  central  constructs,  (3)  conceptualization  of  the  role  of  the  instruct- 
or, (U)  amouxrt  of  structure  associated  with  model  and  (5)  conceptual 
systems  level  whicN  is  appropriate.    The  amount  of  structxire  refers 
to  the  extent  to  vhic.z  the  process  of  instruction  is  controlled  by  the 
instructor.    The  cor^ceptual  level  indicated  is  based  upon  the  attempt 
to  match  the  personality  development  of  the  student  with  an  appro- 
priately structured  environment.    Table  1  has  a  niunber  of  blank  spaces 
because  the  learning  theorist  did  not  attempt  to  relate  his  model  to 
the  instructional  process.    Table  2  compares  the  learning  theories 
with  regard  to  their  implications  for  instruction.    These  implications 
have  been  enumerated  for  the  purpose  of  highlighting  the  similarities 
and  differences  between  learning  theories.    Also,  it  points  out  the 
relevancy  of  each  theory  for  adult  instruct  ion  • 
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Table  1 


A  COMPARATIVE  ANALYSIS  OF  LEARNIilG  MODELS 


Learning 
_  Theory 

Behavlorist 


Neo-Behaviori  st 


Neo«-Behaviori8t 


Neo-Behavlorist 


Name  of 
Model 


Exponent 


Key 
Concepts 


Role  of 
Instrxictor 


Auiount  of 
Structure 


Appropriate 
Conceptxial 
Level  


Operant  B  •  F  *  Reinf orce-»    Behavior  High 

Learning         Skinner        ment  modifier 


iiOV 


Drive 
Reduction 


Clark* 
Hull 


Neuropsycho-  Donald 
logical  Hebb 


Social 
Learning 


Albert 
Bandtira 


Shaping 

Habit- 
family 
hierarchy 

Drive 

Cell  assem-  Source 
blies  AT^d 
phase  se- 
quences 

Mediation 


Imitation 

Vicarious 
learning; 
Symbolic 
models 


Model  and 
Promoter 


High 


Lov 


Neo-Behaviori  st 


Cognitivist 


Cognitivist 


humanist 
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Human 
Engin- 
eering 


Discovery, 
learning 


Reception 
learning 


Robert. 
Gagne 


Manage?^  of 
conditions 
of  learning 


Jerome 
Bruner 


Promoter 
(?) 


Task  anal- 
ysis 

Hierarch- 
ical cate- 
gories of 
learning 

Categori- 
zation 

Coding 
systems 

Advances 
organizers 

Subsumers 

Cognitive 
Structure 


Self-  Carl  Self-actual-Facilitator 

Directed  Rogers  ization  of 

Learning  knowledge 

*  Phenomenol- 

ogical  field 


High 


Lov 


Moderate 


Moderate 


David 
Ausubel 


Dissemin- 
ator of 
information 


High 


Lov 


Lov 


High 


TABLE  2 

I?4PLICATI0NS  OF  MODEL  FOR  INSTRUCTIOH 


(1)  Do  not  use  adversive  stimuli. 

(2)  Do  not  reinforce  xindesired  behavior* 

(3)  In  the  early  stages  of  learning    reinforce  every  desired  response. 
Once  learning  is  proceeding  as  e^qpected,  switch  to  a  "VB"  schedule* 

(k)  Reinforce  immediately,  ^specially  in  early  phases. 

(5)  Establish  convenient  secondary  reinforcers  that  are  facile  to  employ 
at  any  time. 

(6)  Extinguish  undesired  responses  by  witholding  ^reinforcement. 

(7)  When  shaping  ths  behavior  of  individuals,  develop  >^ry  carefully  the 
hierarchical  arrangement  of  responses* 

(8)  When  the  student  fails,  share  the  responsibility. 


Clark  (1)  As  a  first  step  in  learning,  identify  and  eliminate  competitive 

Hull  responses. 

(2)  Introduce  a  variety  of  techniques  for  solving  problems. 

(3)  Determine  the  relative  need  for  practice  at  each  step  in  a  segtrential 
act  and  implement  diffeSrential  practice  until  all  parts  of  the  task 
are  equally  well  learned. 

(li)  Consider  learning  as  a  rearrangement  of  responses  within  a  habit- 
family  hierarchy  such  that  when  the  iudividuail  is  presented  with  a 
stimulus,  the  correct  answer  has  become  the  most  dominant  response 
in  that  particular  habit-family. 


(1)  When  ^^he  backgrotuad  for  adequate  achievements  is  missing,  sxroply 
the  backgroimd  before  worrying  about  achievement. 

(2)  Analyze  a  skill  or  lesson  inuo  components  and  teach  tne  components 
separately. 

(3)  Whenever  feasible,  train  learners  in  the  use  of  mediations!  devices. 


Albert  (l)  Expose  individuals  to  a  wide  rar^/  nf  alternatives  so  that  they  can 

Bandura  decide  for  themselves  who  are  app.     late  models. 

(2)  Utilize  many  types  of  instructions     levices  since  symbolic  models 
are  very  effective. 

(3)  Do  not  necessarily  reqiiire  the  student  to  perform  in  order  to  learn. 


THEORIST 

B.F. 
SKINNER 


Donald 
Hebb 


TABLE  2  -  Cont'd. 


IMPLICATIONS  OF  MODEL  FOR  INSTRUCTIGir 


THEORIST 

Robert 
Gagne 


(1)  MsLke  the  instructional  seq^uence  pareJ-lel  the  hierarchy  of  knowledge 
in  any  given  area. 

(2)  Make  instructional  objectives  specific, 

(3)  Assess  the  learning  situation  in  informal  and  formal  modes  as  an 
important  source  of  f  jedback  for  the  instructor  as  well  as  the  learner. 


JeTOme 
Bruner 


(1)  Utilize  a  spiral  currictzlum  whenever  possible. 

(2)  Encotirage  educated  guessing. 

(3)  See  that  instructional  seq^uence  progresses  from  enactive  to  iconic 
to  symbolic. 

{h)  Generic  codes  are  likely  to  develop  when  training  is  diverse. 

(5)  As  instruction  proceeds,  encourage  the  student  to  asstmie  more 
responsibility  for  learning. 

(6)  Use  inductive  approach;  build  from  specific  category  to  a  coding  systen. 


David  (1)  Organize  material  in  a  form  which  will  be  meaningful  to  the  students. 

Ausubel  In  order  to  accomplish  this,  use  various  kinds  of  organizers. 

(2)  Recognize  that  the  more  distinct  the  new  information  is  from  the 
already  learned  material,  the  greater  the  dissociability  of  the 
material  (i.e.,  it  will  be  retained  longer). 

(3)  Make  sure  that  the  learner  is  ready  to  learn*    This  means  that  the 
individuetl's  cognitive  structure  must  be  assessed  beforehand  so  that 
material  is  introduced  at  the  appropriate  level. 

(h)  Use  deductive  model:  start  with  global  approach  and  integrate  specifics. 


Carl 
Rogers 


erJc 


(1)  Interact  with  students  in  a  genuine,  accepting  and  empathetic  manner. 

(2)  Expect  and  respect  individual  difference^  among  learners. 

(3)  Take  into  account  the  individual  needs  of  the  pupils;  see  that 
students  share  the  responsibility  for  the  content  and  format  of  the 
course . 

(1*)  Develop  self-evaluative  students,  and  when  critizing  the  adult, 
do  so  in  the  form  of  constructive  suggestions. 
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INTEGRATIVE  DISCUSSION  OF  LEARNING  THEORIES 

Whether  a  given  psychologist  will  prefer  some  form  of  an  S-R 
theory  or  a  cognitive  theory  of  learning  depends  partly  on  the  kind 
of  learning  in  which  he  is  interested.    On  the  one  hand,  a  psychologist 
interested  in  studying  the  formation  of  habits  will  prchably  find  a 
S-R  interpretation  more  to  his  liking.    On  the  other  hand,  a  psychologist 
interested  in  studying  the  process  "by  which  man  solves  complex  problems 
will  most  likely  tend  toward  a  cognitive  interpretation. 

The  learning  thf»ories  discussed  in  this  paper  expose  different, 
and  sometimes  conflicting, explanations  of  behavior.    However,  there 
are  some  very  broad  points  of  agreement  which  can  be  easily  overlooked. 
All  S-R  and  cognitive  theorists  agree  that  stimulus-response  relation- 
ships are  complex  and  that  learning  requires  identification  of  the 
relevant  stimuli  in  a  complex  field.    They  also  are  in  agreement 
concerning  the  existence  of  individual  differences.    Both  orientations 
acknowledge  that  individuals  differ  in  their  capacity  to  recognize 
or  discriminate  relevant  stimuli  and  that  the  task  has  to  be  appro- 
priate to  and  within  the  range  of  competence  of  the  person.  Furthermore, 
with  regard  to  the  capacity  of  individuals  to  make  the  required  response, 
the  two  positions  concur  that  whatever  the  individual's  response  reper- 
toire may  be,  stimtilus  conditions  may  be  arranged  to  increase  the 
probability  of  the  occurrence  of  the  desired  response  relative  to 
alternative  responses.    The  S-R  and  cognitive  theories  both  matintain 
that  motivation  initiates  and  directs  behavior  and  that  it  leads  to 
particular  responses  which  are  directed  towctrd  achieving  a  specified 


goal*    Too,  excessive  motivation  is  disruptive  for  the  learner  because 
it  prevents  him  from  clearly  perceiving  the  complex  of  stimulus-response 
relationships.    Finally,  both  orientations  agree  on  the  necessity  of 
the  learner •s  recognizing  whether  his  response  is  appropriate  and 
modifying  the  response  whenever  it  is  inappropriate.    This  involves 
taking  into  acco\int  his  previous  experience. 

The  chief  distinction  between  the  behavioristic  position  adhered 
to  by  Skinner  and  the  neo-behavioristic  positions  of  Hull,  Hebb,  Bandxira 
and  Gagne  is  that  the  latter  theorists  have  incojrporated  medlational 
processes  into  their  theories.    Bf  doing  so,  these  theorists  can  account 
for  more  complex  kinds  of  learning  such  as  concept  forma^;ion.  With 
regard  to  their  specific  implications  for  instruction,  the  implications 
of  Skinner  do  not ,  for  the  most  part ,  conflict  with  those  of  the  neo- 
behaviorists .    One  instance  in  which  there  is  disagreement,  however, 
is  the  necessity  of  the  learner  being  active  in  order  to  learn.  Bandura 
has  proposed  that  learning  can  occur  without  the  learner  directly 
performing  the  response.    Ifowever,  even  in  thir.  case,  the  learner  must  * 
still  be  active  in  some  sense(i.e.,  he  must  be  paying  attention  to 
the  model.)    Within  the  neo-behavioristic  orientation,  there  is  general 
agreement  of  the  need  for  varied  experience  ^d.th  the  material  to  be 
learned.    The  position  represented  by  Bandura  can  be  differentiated 
from  the  other  neo-behavioristic  positions  in  that  social  learning 
attempts  to  provide  insight  into  the  merns  by  which  novel  response 
acquisition  occurs  while  the  other  theories  have  been  concerned  largely 
with  the  question  of  response  performance.    Hull,  Hebb  and  Gagne^all 
stress  that  the  teacher  must  determine,  prior  to  instruction,  the 
hierarchy  of  responses  which  are  deemed  necessary  for  the  learner  to 
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be  successful.    The  cognitive  position  can  easily  be  differentiated 
from  the  behavioristic  one  in  terms  of  its  concern  for  man's  ability 
to  transform  stimuli,  process  information  and  represent  external  events 
internally  in  the  form  of  cognitive  structure.    The  distinction  between 
the  neo-behaviorists  and  the  cognitivists  are  not  as  great,  but  the 
neo-behavlorlsts  use  mediation  only  as  a  hypothetical  construct  to 
link  observable  events.    There  is  certainly  some  disagreement  between 
Bruner  and  Ausubel  concerning  the  most  effective  means  of  instruction 
within  the  cognitive  orientation.    One  of  the  major  differences  between 
the  two  approaches  concerns  the  arrangement  of  material.    Bruner  believes 
that  material  should  be  arranged  hierarchially  with  specific  facts  at 
the  base  of  the  hierarchy.    Ausubel,  in  direct  contrast,  espouses  the 
irtroducticr.  of  general  concepts  before  the  learning  of  specifics. 
The  second  issue  of  which  the  two  theorists  differ  concerns  the  organi- 
zation of  material.    Bruner  advocates  permitting  the  learner  to  organize 
material  for  himself  by  discovery  techniques  while  Ausubel  opts  for 
a  controlled  presentation  of  material  in  its  final  form. 

The  rapproachment  of  these  two  positions  begins  with  the  acknowl- 
edgement th'at  they  are  not  necessarily  mutually  exclusive.  Research 
suggests  that  expository  techniques  favor  rapid  learning  and  longer 
retention  ( Craig,' 1965;  Haslerud  and  Myers,  1958;  Wittrock,  1963)  whereas 
discovery  facilitates  transfer  (Guthrie,  196? ).    Ausubel  himself  (l969, 
pp.  U83-U8U)  concedes  that  discovery  methods  may  be  advantageous  under 
certain  conditions:  (l)  for  teaching  in  the  early  grades,  (2)  for 
testing  meaningfulness  and  problem  solving,  (3)  for  ensuring  transfer- 
ability and  (!♦)  for  establishing  intrinsic  motivation. 
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CONCLUSION 

It  woiild  be  extremely  helpful  if  we  co^ild  provide  the  reader  with 
some  closure  with  respect  to  which  theory  of  learning  has  the  most 
potential  for  research  and  instruction  in  adult  education.  Unfortunately 
this  is  not  possible.    Eexih  theory  is  able  to  account,  in  a  relative 
sense,  for  certain  phenomena  and  unablt;  to  account  for  others.  Learning 
theorishs  themselves,  have  in  recerb  years  (except  for  Berlyne,  I965)  foregone 
attenqpts  to  formulate  macro  theories  of  learning*    Instead,  the  trend 
has  been  toward  micro  theories — theories  which  scope  include  a  limited 
number  of  phenomena. 

It  is  a  further  concern  of  those  associated  with  adult  education 
that  a  theory  of  learning  be  tailored  to  account  for  differences  between 
the  adult  and  other  learners.    Yet  the  differences  between  the  adult 
learner  and  other  learners  have  not  been  delineated  to  any  great  extent. 
The  principles  of  lesLming  are  assumed  to  apply,  with  minor  variations 
introduced,  to  the  adult.    Until  these  differences,  if  in  fact  they  do 
exist,  are  determined  the  formulation  of  learning  models  which  have 
implications  primariUy  towards  adults  is  not  possible. 

Though  the  problem  of  how  can  one  implement  the  implications  of 
learning  theories  is  beyond  the  scope  of  this  paper,  it  becomes  a  large 
and  distressing  problem  for  many  adult  instructors.    The  issues  to  which 
principles  of  learning  are  applicable,  in  what  contexts  should  they  be  used, 
€Uid  with  what  type  of  student,  remain  open  questions.    Thus  it  appears 
that  there  are  two  distinct  questions  to  which  adult  education  research- 
ers should  presently  address  themselves  to:  (l)  What  are  the  differences 
between  the  means  by  which  adiilts  and  others  learn?  (2)  How  can  we  opera- 
tionalize  the  implications  of  learning  theories  into  classroom  practices? 
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A  NEW  DIMENSION  IN  PROGRAM  DEVEL^^P'  ENT  THEORY* 

"A  man  becomes  more  and  more  a  free  and  responsible 
agent  the  more  he,  at  all  times,  knows  what  he  is  doing  in 
every  sense  of  the  phrase,  and  the  more  he  acts  with  a 
definite  and  clearly  formed  intention. " 

Stuart  Hampshire  in  Thought  and  Action 

Introduction 

Few  people  in  adult  education  would  quarrel  with  that 
bit  of  philosophy  espoused  by  Hampshire.     In  fact  we  really 
say  the  same  thing  when,  in  our  more  philosophical  moments, 
we  argue  that  it  is  "meet  and  right*'  to  involve  our  clientele 
in  program  determination.     However,   just  as  John  Dewey's 
philosophy  of  progressive  education  and  learner  involvement 
was  misinterpreted  by  curriculum  planners  in  formal  education, 
it  is  the  position  of  this  paper  that  adult  educators  have 
similarly  misinterpreted  the  concept  of  clientele  involvement 
in  program  planning.     One  senses  from  the  literature  of  adult 
education  curriculum  development  that  failure  to  involve 
groups  of  local  citizens  in  a  laborious  analysis  of  "the 
situation"  for  the  purpose  of  identifying  "the  relevant  needs" 
is,   in  fact,  not  a  proper  planning  process. 
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G.M.  Farrell,   paper  presented  to  Adult  Education  Research 
Conference,  April  4-6,   1973,  Montreal,  Quebec. 


For  example,  Boyle, ^  in  an  attempt  to  synthesize  a 
process  of  program  development  from  existing  research, 
identified  the  organization  and  maintenance  of  a  client 
planning  group  as  one  of  the  phases  in  the  process,  Aleshir 
in  a  comprehensive  discussion  of  viewpoints  on  citizen 
participation  in  community  development,  and  the  costs  and 
benefits  thereof,  concludes  that  such  planning  requires  the 
participation  of  citi^3ens.      Rohfeld,  ^  in  a  recent  issue  of 
Adult  Education,  argues  for  client  involvement  in  program 
planning  as  the  process  ingredient  which  can  prevent  the 
molding  of  the  learner  to  the  educator's  own  concept  of 
society. 

There  are  three  basic  premises  which  underlie  the 
concept  of  client  involvement  in  program  development.^ 

1.  More  accurate  decisions  regarding  the  relevant 
needs  and  opportunities  upon  which  Extension  programs  should 
focus  will  be  arrived  at  when  lay  people  are  involved  in 
making  those  decisions.     The  notion  here  is  that  people, 
when  provided  with  the  real  facts  of  the  situation,  will 
identify  the  more  critical  problems  with  which  they  are 
faced . 

2.  The  involvement  of  citizen  representatives  will 
speed  up  the  process  of  change  among  people.     The  assumption 


being  that  those  who  are  involved  will  aid  in  diffusing  and 
legitimizing  subsequent  educational  programs. 

3.     Involvement  in  curriculum  development  is  a 
learning  experience.     Participants  in  planning  committees 
should  be  better  informed  and  better  prepared  for  active 
leadership  in  the  process  of  change. 

Of  these  three  premises,  however,  many  writers 
suggest  that  involvement  for  the  purpose  of  identifying  the 
more  relevant  needs  and  opportunities  is  paramount.  According 
to  Vandeberg:       "...  the  primary  purpose  of  any  planning 
is  first  and  foremost  that  of  developing  a  sound,  defensible 
and  progressive  course  of  action — a  plan.     In  the  process 
followed,  many  other  benefits  might  accrue --such  as  the 
education  of  participants — but  we  want  a  plan  that  can  and 
will  be  used. " 

The  Problem 

No  one  would  dispute  the  notion  that  the  end  result 
of  any  planning  effort  ought  to  be  a  sound,   defensible  and 
progressive  plan.     However,   not  everyone  agrees  that  involve- 
ment of  clientele  is  the  only  way  that  the  goal  can  be  realized. 
The  virtual  universal  commitment  of  adult  education  organizations 
to  this  philosophy  has  led  to  frustration,  inefficiency  and 
often  ineffectiveness  on  the  part  of  many  "front  line" 


practitioners  of  adult  education.     Bruce    suggested  two 

hints  of  evidence  to  support  this  analysis.     One  is  that  some 

recalcitrant  Extension  workers  have  for  years  carried  out 

successful  programs  without  engaging  in  formal  planning  at  all. 

Secondly,  as  we  work  with  new  areas  of  subject  matter  and  new 

audiences,   and,   as  our  old  audiences  become  more  sophisticated 

and  specialized,  we  are  finding  that  old  procedures  and  concepts 

of  program  planning  do  not  always  provide  an  efficient  basis 

for  devising  workable  programs. 
8  . 

Brower,     in  his  analysis  of  the  philosophic  dilemma 
of  adult  educators,  presents  a  rather  clear  picture  of  the 
alternatives.     He  identifies  four  approaches  to  curriculum 
development.     The  academic  approach  in  which  professional 
authority  is  primary;  the  grass  roots  approach  in  which  the 
learner  primarily  makes  the  curriculum  decisions;  the 
education- for -reality  approach  whereby  the  professional  and 
the  learner  are  mutually  involved  in  developing  the  curriculum; 
and  the  propaganda  approach  in  which  curricula  are  developed 
by  a  third  party,  excluding  both  the  learner  and  the 
professional.     An  example  of  this  would  be  the  adult  education 
programs  of  various  agencies  or  organizations  who  are  promoting 
or  selling  their  particular  ideas  or  vested  interests. 

There  is  ample  evidence  to  suggest  that  the  answer 
to  this  dilemma  does  not  lie  entirely  in  one  approach  versus 


all  others.     Consider,   for  example,  the  number  of  "canned" 
curricula,   planned  entirely  by  professionals,  that  have  met 
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with  abject  apathy  on  the  part  of  clientele?  or  the  studies 
which  show  that  problems  identified  by  citizen  planning  groups 
are  sometimes  identified  without  any  basis  in  terms  of  the 
social  and  economic  facts  of  the  community.     Whale  and  Boyle^^ 
suggest  that  limited  rationality  should  be  an  anticipated 
result  ifrom  group  planning  unless  the  professional  is  willing 
to  expend  much  more  effort  in  training  and  working  with  lay 
planning  groups  than  has  been  the  case  so  far. 

This  is  not  to  argue  against  involvement  from  the  point 
of  view  that  the  learner  should  understand  the  basis  for 
educational  programs  that  may  affect  his  life.     However,  it 
is  the  purpose  of  this  paper  to  question  the  position  that 
this  is  always  best  accomplished  by  involving  the  clientele 
as  members  of  program  planning  committees. 

An  Alternative  Perspective 

Perhaps  one  of  the  errors  made  by  the  pundits  of  program 
planning  literature,  and  indeed  the  underlying  research  effort, 
has  been  the  "channel  visioned"  attempt  to  identify  the 
curriculum  development  process  rather  than  processes.     In  many 
ways  the  approach  to  date  has  been  analagous  to  the  early 


efforts  of  social  scientists  to  define  leadership  using  only 
personality  theory — failing  to  recognise  that  the  context 
within  which  leadership  occurs  has  an  important  effect  on  who 
can  and  should  play  a  leadership  role. 

The  assumption  that  the  best  plans  are  these  in  which 
local  people  have  been  involved  in  identifying  needs  and 
opportunities  appears  to  have  channeled  cur  efforts  into  a 
search  for:     1)  criteria  by  which  local  people  can  be  selected 
who  will  be  effective  planners,  and  2)  ways  in  which  citizen 
committees  can  more  effectively  function  as  problem-solving 
groups •     The  possibility  that  in  a  given  situation  involvement 
of  local  people  through  a  process  of  group  problem-solving  may 
not  be  on.  y  inefficient,  but  also  an  inaccurate  process  for 
determining  curriculum  focus,  has  received  little  attention. 
Again  this  is  not  to  argue  against  involvement,  but  rather  to 
raise  the  question  of  involvement  for  what  purpose?  The 
importance  of  this  question  cannot  be  overstated  for  it  has 
a  direct  implication  for  those  responsible  for  curriculum 
development  in  terms  of  who  should  be  involved  and  the  process 
of  their  involvement. 

For  example,   if  we  do  in  fact  decide  we  must  have 
citizen  involvement  in  order  to  know  the  relevant  needs,  the 
required  process  model  is  that  of  group  problem-solving.  This 


has  specific  implications  for  the  type  of  citizen  who  should 
be  involved  and  for  the  role  of  the  professional.     On  the 
other  hand,   :.f  the  purpose  of  involvement  is  that  of  gaining 
acceptance  and  legitimation  of  the  curriculum,  the  relevant 
process  is  that  of  communication — again  with  important 
implications  for  the  procedure  of  citizen  i.ivolven*  nt.  If 
the  purpose  of  involvement  is  that  it  be  an  educational 
experience,   the  process  becomes  one  of  establishing  a  learning 
experience.     There  is  evidence  that  involving  local  people  for 
purposes  of  problem-solving  does  not  necessarily  result  in  their 
learning  about  either  the  process  or  their  community. This 
suggests  that  if  involvement  is  to  be  an  educative  experience 
it  requires  a  deliberate  effort  on  the  part  of  the  adult 
educator . 

What  is  required  then  is  some  basis  for  making 
decisions  regarding  the  purposes  of  citizen  involvement.  I' 
is  our  position  that  this  basis  lies  in  an  analysis  of  tae 
nature  of  the  planning  task — the  problem  area  within  which 
a  curriculum  is  to  be  developed — rather  than  a  philosophic 
statement  about  'the  "goodness"  of  democratic  decision-making. 

Toward  a  Typology  of  Planning  Tasks 

Much  of  the  present  theory  of  the  process  cr  curriculum 
development  appears  to  have  originated  from  research  in  the  area 
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of  group  dynamics — particularly  the  work  of  Bales      and  his 
associates  on  group  problem -solving.     Adult  educators^ 
primarily  those  in  Co-operative  Extension,  have  prescribed 
this  as  standard  operating  procedure  without  regard  to  the 
nature  of  the  planning  task  confronting  the  group.  This 
practice  fails  to  consider  other  relevant  findings  from  this 
same  body  of  knowledge.     For  example,  it  has  been  clearly 
demonstrated  that  group  problem-solving  is  superior  to  individual 
problem -solving  only  under  certain  task  conditions:      (1)  those 
which  are  complex,  thereby  allowing  for  gains  due  to  division 
of  labor,  and  (2)  those  in  which  individual  decisions  are 
subject  to  random  error  so  that  collective  decision-making 
tends  to  reduce  error  through  cancellation.^^     It  seems 
entirely  reasonable  to  suggest  that  not  all  problem  areas  which 
confront  program  planners  are  constant  in  terms  of  these 
variables. 

Several  small  group  researchers  have  commented  on  this 

point.     Hoffman      has  suggested  that,  until  a  taxonomy  of  task 

problems  is  developed,   further  investigation  into  the  nature  of 

group  problem- solving  is  unlikely  to  be  very  fruitful.  Some 

15 

authors  have  made  attempts  in  this  direction.  Fiedler 
attempted  to  operationalize  four  criteria  for  the  classification 
of  group  tasks.     These  included:     (1)  decision  verif iability — 
the  degree  to  which  the  correctness  of  the  solution  can  be 


demonstrated  d3jecti\^ly;    (2)  goal  clarity — the  degree  to  which 
task  requirements  are  clearly  stated  or  known  to  the  group; 
(3)  goal  path  multiplicity — the  degree  to  which  there  are  many 
or  few  procedures  available  for  performing  the  task;  (4) 
solution  specificity — the  degree  to  which  there  is  one  rather 
than  an  infinite  number  of  correct  solutions.     Fiedler  used 
these  criteria  to  develop  an  index  of  group  task  structure • 
High  task  structures  were  defined  as  those  for  which: 
1)   decisions  can  be  verified  with  objective  data;  2)  goals 
are  clear;  3)  the  number  of  alternative  procedures  for 
performing  the  task  are  limited;  4)  the  nuiuber  of  "correct" 
solutions  is  limited.     Generalizing  from  his  findings  one 
can  suggest  that  citizen  involvement  in  the  form  of  group 
decision-making  is  less  important  under  conditions  of  high 
task  structure  since  the  opportunity  for  division  of  labor  and 
error  reduction  is  much  lower  than  is  the  case  with  low  structure 
tasks. 

There  is  evidence  also  that  business  management  planning 

is  beginning  to  recognize  the  relevance  of  the  nature  of  the 

1 6 

planning  task  for  the  process  which  is  followed,     Delbecq  has 
suggested  a  model  involving  three  decision-making  procedures. 
(1)  Routine  decision-making  in  which  the  problem  is  clear  and 
the  need  is  for  highly  specialized  inputs  of  information  in  order 
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to  arrive  at  a  solution.   (2)  Creative  decision -making  whereby 

decisions  evolve  quite  apart  from  the  expertise  of  the 

specialist.     In  this  situation,  an  objective  basis  on  which 

to  make  decisions  is  lacking.     Therefore,  the  opinions  and  the 

ideas  of  the  group  become  all  important.     (3)  Negotiated 

decision-making  involving  opposing  factions,  generally  brought 

about  by  conflicting  opinions  regarding  ends  or  means  or  both. 

In  the  context  of  curriculum  planning  one  can  suggest  that 

citizen  involvement  for  the  purpose  of  need  identification  is 

less  important  in  the  first  instance  and  much  more  important 

in  the  latter  two  situations. 
17 

Maier      has  suggested  that  there  are  two  aspects  to  any 
decision:      (1)  its  purely  objective  or  impersonal  attributes, 
which  he  defines  as  the  quality  aspect,  and  (2)  its  attractiveness 
or  desirability  to  persons  who  must  work  with  the  decisions — 
the  acceptance  aspect.     The  first  depends  upon  objective  data 
(facts  in  the  situation);  the  second  on  subjective  data  (feelings 
which  are  in  people) . 

According  to  Mc.ier,   problems  can  be  examined  with  respect 
to  the  degree  in  which  quality  and  acceptance  are  implicated. 
Problems  classified  as  Q/A   (quality  prior)  are  those  for  which 
effective  solutions  can  be  arrived  at  on  the  basis  of  objective 
dnta.    Acceptance,  although  still  important,  is  of  secondary 
::oncern  and  may  be  gained  in  several  ways:      (1)  imposition  of 
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the  decision;    (2)  using  the  legitimate  and/or  referent  power 
basis  of  the  person (s)  making  the  decision;    (3)  utilizing  a 
persuasive  approach  by  explaining  the  virtues  of  the  decision; 
(4)  using  a  participative  approach  which  encourages  discussion 
of  the  decision (s)  in  order  to  develop  understanding  of  the 
reasons  for  the  decision.     A/Q  (acceptance  prior)  problems 
are  those  for  which  objective  data  are  either  not  available 
or  not  helpful  in  making  effective  decisions.     In  such  instances, 
the  subjective  input  (feelings,  values)  of  those  to  be  affected 
is  the  primary  input  and  can  only  be  obtained  through  active 
client  involvement  in  the  planning  process. 

The  essential  point  for  curriculum  development  theory 
is  that  some  typology  for  classifying  planning  tasks  is  needed 
in  order  to  make  valid  judgments  about  the  purpose  and  process 
of  citizen  involvement  in  program  planning.     This  seems  especially 
necessary  as  the  clientele  of  adult  education  organizations 
becomes  more  and  more  heterogeneous.     As  this  occurs,  the 
variability  of  the  program  planning  tasks  confronting  agents 
ali,o  increases.     In  this  context,  a  theory  of  program  planning 
which  continues  to  view  the  planning  task  as  a  uni-dimensional 
variable  makes  little  sense. 
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An  Alternative  Theory 

The  foregoing  discussion  suggests  that  the  particular 
task  which  confronts  a  decision-making  group  should  be  viewed 
as  a  random  variable.     In  other  words,  tasks  vary  in  terms  of 
the  inputs  required  to  arrive  at  decisions  that  are  of  high 
quality  and  acceptability.    As  was  pointed  out,  two  major 
sources  of  variability  are:    (1)  the  degree  to  which  decisions 
can  be  based  on  objective  data;  and  (2)  the  specificity  of  the 
problem  in  terms  of  the  range  of  alternative  solutions  it 
affords. 

In  light  of  these  arguments,  an  alternative  theory  of 
program  development  should  meet  two  major  objectives.  First, 
it  should  provide  a  set  of  criteria  for  discriminating  among 
various  types  of  planning  tasks.     Second,   it  should  provide  a 
basis  for  determining  the  most  appropriate  roles  of  the  various 
parties  involved  in  the  program  development  process  (e.g.,  the 
professional  adult  educator,  the  client,  the  subject  matter 
specialist,  etc.) 

The  model  shown  in  Figure  1  is  an  attempt  to  meet  t:he 
first  of  these  objectives. 
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Objective  Data  Base 


Criteria 

1.  Identification  of  learning 
needs  can  be  based  on 
factual  data. 

2.  The  range  of  alternative 
learning  experiences 
that  would  meet 
identified  needs  is 
limited. 


Limited 
Range  of  7* 
Iter natives 


Type  A  planning  tasks 


Criteria 


1.  Identification  of  learning 
needs  must  be  based 
primarily  on  the  subjective 
ideas  and  opinions  of 
clientele. 

2.  The  range  of  alternative 
learning  experiences  that 
would  meet  identified 
needs  is  limited. 

Type  C  planning  tasks 


Criteria 

1.  Identification  of  learning 
needs  can  be  based  on 
factual  data. 

2.  The  range  of  alternative 
learning  experiences 

that  would  meet  identified 
needs  is  wide. 


Type  B  planning  tasks 


Wide  Range 
of 

Alternatives 


Criteria 

1.  Identification  of  learning 
needs  must  be  based  primarily 
on  the  sxibjective  ideas  and 
and  opinions  of  clientele. 

2.  The  range  of  alternative 
learning  experiences  that 
would  meet  identified  needs 
is  wide. 

Type  D  planning  tasks 


Subjective  Data  Base 

Figure  1.     A  Theoretical  Model  for  the  Classification  of 
Planning  Tasks. 


Di  scussion 

The  model  shown  in  Figure  1  attempts  to  utilize  the  two 
major  sources  of  planning  task  variability  previously  identified. 
For  example,   some  plannii^g  tasks  clearly  lend  themselves  to  a 
need  identification  process  based  on  available  objective  data 
such  as  social  and  economic  statistics  and  agricultural 
projection  records.     Other  planning  task  situations  do  not — either 
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because  the  situation  does  net  lend  itself  to  quantitative 
analysis  or  because  such  information  is  not  available  (e.g., 
time  and  cost  factors  prohibit  its  collection  and  analysis). 

The  second  variable  in  the  model  refers  to  the  range 
of  alternative  learning  experiences  that  can  potentially  be 
provided  in  order  to  meet  the  needs  identified.     Two  major 
constraints  define  this  variable.     The  first  is  the  degree 
to  which  the  solution  to  a  problem  (need)  is  clear  because  of 
known  information.     In  other  words,  once  the  need  is  identified, 
it  is  possible  to  "prescribe'*  the  required  learning  experience 
because  of  existing  knowledge.     The  second  constraint  is  the 
degree  to  which  the  programming  agency  is  free  to  provide 
various  kinds  of  learning  experiences.     For  example,  the 
policies  and/or  the  resource  base  of  a  given  agency  may 
preclude  the  feasibility  of  meeting  a  broad  range  of  needs. 

In  more  specific  terms,   the  model  provides  a  theoretical 
frame  of  reference  for  distinguishing  among  four  types  of 
planning  tasks.     Type  A  tasks  are  those  for  which  learning 
needs  can  be  identified  on  the  basis  of  objective,  factual 
data.     Further,  the  kind  of  learning  experience (s)  required 
to  meet  needs  can  be  prescribed  precisely  on  the  basis  of 
existing  knowledge.     For  example,  an  adult  educator  responsible 
for  planning  educational  programs  ttet  improve  agriculture 
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prociuction,  can,  specialists'  input,  analyze  current 

practices  and  productivity  and  make  comparisons  with  what 
"should  be"  on  the  basis  of  existing  knowledge.     It  may  be 
determined,   for  instance,   that  learning  experiences  designed 
to  change  cultural  practices  are  required.     A  community  public 
health  educator  may  well  encounter  many  similar  planning 
tasks  in  which  the  diagnosis  of  need  and  the  prescription  of 
the  educational  solution  are  possible  through  an  objective 
analysis  of  the  clients*  situation  and  consideration  of  known 
cause  and  effect  relationships. 

Type  B  planning  tasks  are  those  in  which  a  broad  range 
of  needs  can  be  described  through  objective  analysis  as  can 
the  range  of  learning  experiences  which  would  meet  rhose  needs. 
However,  what  the  adult  educaror  lacks  in  this  planning  task 
is  an  objective  basis  for  deciding  on  the  priority  of  needs. 
Consider,  for  example,  a  poverty  worker  responsible  for  the 
design  and  implementation  of  an  educational  program  in  the 
inner  city  which  would  improve  the  overall  quality  of  life  for 
people  in  that  community.     With  the  assistance  of  appropriate 
subject  matter  specialists,   it  is  possible  to  analyze  the 
situation  and  describe  a  number  of  needs  relating  to  economic 
opportunities,   health  care,  education,   homemaking  skills,  etc. 
It  is  also  possible  to  describe  the  range  of  learning  experiences 
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which  would  meet  such  needs.     The  problem  is  however  that 
neither  the  adult  educator  nor  the  subject  matter  specialists 
have  an  objective  basis  for  determining  priorities  among  these 
needs* 

Type  C  planning  tasks  differ  from  type  B  in  two  major 
ways.     First,  the  range  of  needs  and  alternative  learning 
experiences  that  can  be  considered  by  the  adult  educator  is 
much  more  constrained.     Second,  within  the  range  of  needs 
and  learning  experiences  that  can  be  considered,   there  are  no 
objective  data  available  to  assifst  in  identifying  the  specific 
needs  for  which  programs  should  be  developed.     Examples  of 
the  kinds  of  constraints  that  the  adult  educator  often  encounters 
include:     agency  instructional  rostources,  agency  policy,  agency 
finances  and  granting  policies  of  senior  governments.     A  specific 
example  of  a  type  C  planning  task  might  be  an  adult  educator 
working  for  a  community  board  of  education.     She  may  find  that 
board  policies,   the  instructional  resources  available  to  her 
program,  and  the  nature  of  the  granting  policies  of  senior 
governments  dictate  that  t.he  range  of  educational  needs  which 
can  be  considered  is  limite:!  to  those  which  can  be  responded  to 
through  formal  upgrading  classes.     However,  there  are  no 
objective  data  available  to  decide  whether  grade  ten  math  is  a 
greater  need  than  grade  nine  social  studies.     Those  decisions 
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must  be  made  on  the  basis  of  the  perceptions  of  the  individual 
clients. 

Type  D  planning  tasks  are  perhaps  the  easiest  to 
conceptualize,     in  many  respects  this  type  of  task  is  the 
one  from  which  we  have  generalized  the  principle  that  client 
involvement,  through  planning  committees,   should  be  a  constant 
ingredient  in  the  planning  process.     This  type  of  task  is 
characterized  by  the  fact  that  there  are  virtually  no  constraints 
on  the  range  of  needs  and  alternative  learning  experiences 
that  should  be  considered.     Further,   there  are  no  factual 
objective  data  available  to  the  adult  educator  to  permit  him 
to  play  a  directive  role  in  need  identification  (at  least  at 
the  outset).     Perhaps  the  most  common  example  vould  be  the 
adult  educator  faced  with  evolving  the  educational  component 
of  a  total  resource  development  plan  for  a  community. 

It  should  be  recognized  that  the  classification  of 
planning  tasks  is  a  dynamic  problem — not  a  static  one.  In 
otixer  words  it  cannot  be  assumed  that  the  nature  of  the  planning 
task  remains  constant  after  inicial  classification. 

At  the  outset,   for  example,   a  planning  task  may  be  quite 
abstract  and  general.    According  to  the  model  criteria,  it 
would  be  classified  as  a  type  D  task.     However,  as  the  planning 
process  proceeds,  the  task  may  become  more  specific  with 
existing  data  becoming  a  relevant  input.     The  adult  educator 
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responsible  for  the  process  should  be  sensitive  to  task  changes 
since  these  have  implications,   in  theory  at  least,   for  all 
parties  involved  in  the  planning  process. 

Roles  in  Planning 

The  availability  of  an  objective  data  base  on  which  to 
determine  needs,   coupled  with  the  limited  range  of  learning 
experiences  which  would  obviously  meet  such  needs,  suggests 
that  in  type  A  task  situations,   the  establishment  of  a  client 
planning  committee  to  perform  these  functions  would  be  redundant. 
The  adult  educator  and  subject  matter  specialists,  can  perform 
these  functions  on  the  basis  of  the  factual  data  available, 
.''.crceptance  of  the  program  may  be  gained  through  an  educational 
process  designed  to  develop  an  understanding  of  the  basis  for 
the  needs  identified  and  the  learning  experience (s)  that  will 
take  place. 

Type  B  tasks  also  permit  the  adult  educator  and  subject 
matter  specialists  to  play  a  directive  role  in  terms  of 
identifying  alternatives  for  program  emphasis.     However,  they 
Ic    c  an  objective  basis  for  placing  priorities  on  those 
alternatives.     In  this  situation  client  groups  may  be  initially 
established  as  a  learning  group.     The  adult  educator  provides 
learning  experiences  designed  to  develop  an  understanding  of  the 
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various  alternatives.     in  latter  stages  of  the  planning 
process,   however,  the  group  function  becomes  that  of  making 
decisions  among  those  alternatives. 

The  subjective  nature  of  type  C  tasks  suggests  that 
the  program  clientele  are  the  primary  data  source  for  the 
identification  of  program  needs.    However,  it  should  not  be 
assumed  that  the  establishment  of  client  planning  committees 
is  the  most  efficient  and  effective  means  of  obtaining  this 
input.     For  example,  the  constraints  defining  the  range  of 
alternative  learning  experiences  may  permit  the  adult  educator 
to  identify  and  priorize  specific  needs  through  a  checklist  or 
cafeteria  programming  approach.     Given  the  individualized 
nature  of  the  need  decision,   it  is  doubtful  if  a  client 
committee  could  accurately  reflect  needs  in  any  cast. 

The  subjective  opinions  of  clientele  also  constitute 
the  primary  data  source  for  identifying  needs  relating  to 
type  D  planning  tasks.     The  wide  range  of  alternatives  afforded 
by  this  type  of  task  suggests  that  clientele  involvement  through 
small  group  decision-making  v/ould  be  the  most  efficient  and 
valid  means  of  determining  progran-  focus.     In  this  case  need 
identification  and  program  legitimation  occur  through  the 
same  process. 
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A  parting  word 

The  foregoing  notions  should  not  be  interpreted  as  an 
argument  against  the  concept  of  citizen  involvement.  They 
should  be  interpreted  as  underlining  the  need  for  adult 
educators  to  ask  the  questions  "why"  and  "how,"    Further,  it 
should  be  re-emphasized  that  the  planning  task  classification 
model,  and  the  suggested  roles  of  partieis  involved  in  the 
planning  process,  should  be  regarded  as  theoretical  propositions 
The  point  on  which  we  do  not  hedge  is  thait  these  are  critical 
research  questions  for  adult  educators.     Hopefully,  their 
investigation  ^ill  permit  all  of  us  to  involve  our  clientele 
in  a  more  meaningful  way  during  the  process  of  developing 
"sound  and  acceptable"  educational  program  plans. 
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Purposes 

The  purposes  of  this  study  were:  1)    to  identify  the  existence  and 
nature  of  clusers  of  reasons  given  by  adults  for  enrolling  in  a  directed 
self-study  bachelor's  degree  program;   2)   to  test  the  relationships  bet- 
ween, on  the  one  hand,  identified  variables  of  adult  students'  sex,  age, 
marital  status,  level  of  income,  kind  of  employment,  previous  college 
experience,  and,  on  the  other  hand,  identified  clusters  of  reasons  for 
enrolling  if=  such  a  program;    3)    to  compare  the  reasons  for  enrolling  in 
such  a  program  by  those  who  have  withdrawn  from  such  a  program  with  those 
who  have  completed,  or  are  still  continuing  in  such  a  program. 

The  Hypotheses 

The  following  eight  null  hypotheses  were  tested  in  the  present  study: 

1.  There  is  no  significant  difference  among  factor  scores  in 
preferences  of  one  choice  over  another  selected  by  adults  as 
reasons  for  enrolling  in  a  directed  self-study  bachelor's 
degree  program, 

2.  There  is  no  significant  difference  between  adult  men  and 
women  for  each  of  the  motivational  factors  for  enrolling  in 

directed  self-study  bachelor's  degree  program, 

3.  There  is  no  significant  difference  for  each  of  the -motivational 
factors  selected  for  enrolling  in  i  directed  self-study 
bachelor's  degree  program  by  marital  statJS, 

4.  There  is  no  signifivant  difference  among  xge  groups  for  each 
of  the  motivational  factors  for  erironiny  in  a  directed  self- 
study  bachelor's  degree  program, 

5.  There  Is  no  significant  difference  between  the  employed  and  un- 
employed for  each  of  the  motivational  factors  for  enrolling  in 
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a  directed  self-study  bachelor's  degree  program. 

6.  There  is  no  significant  difference  between  adults  who  have 
had  previous  college  credit  experience  or  not,  for  each  of 
the  motiviatlonal  factors  for  enrolling  in  a  directed  self- 
study  bach  .^r  s  degree  program. 

7.  There  is      significant  difference  for  each  of  the  motivational 
factor  for  enrolling  in  a  directed  self-study  bachelor's 
degree  program  by  level  of  income. 

8.  There  is  no  significant  difference  for  each  of  tht  motivational 
factors  selected  by  adults  who  have  withdrawn  from  such  a  pro- 
gram, or  who  have  completed,  or  who  are  still  enrolled  but.in- 
active,  or  who  are  still  actively  participating  in  a  directed 
self-study  bachelor's  degree  program. 

Subjects 

The  total  population  of  269  adults  enrolled  in  the  directed  self-study 
bachelor's  degree  program  at  University  College,  Syracuse, University,  wai 
used  in  this  investigation. 

A  two-part  self -administered  questionnaire  was  mailed  to  each  person 
enrolled      the  program  at  Syracuse  University  '  m  the  program's  inception 
in  1966  through  May  1971.  Part  one  was  an  instrument  to  obtain  demographic 
data;  part  two  was  a  70-item  instrument,  adpated  from  one  used  by  Paul  Burgess, 
to  obtain  reasons  for  enrolling  in  a  directed  self-study  bachelor's  degree 
program.  One  hundred  and  eighty  usable  questionnaires  were  received,  constituting 
a  69.1  per  cent  return  rate. 

Characteristics  of  Respondents 

Of  the  180  respondents,  123  or  68.3  per  cent  were  men,  wnile  57  or 
31.7  per  cent  wera  women.   Tahles  1  through  7  show  the  distribution  of 
O  subjects  by  various  aspects  of  "^OTograph^^^^ 
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TABLE  1 

DISTRIBUTION 

OF  SUBJECTS 

BY  AGE  GROUPS 

Age  Group 

N 

Per  cent 

25  and  under 

10 

5.6 

26-30 

27 

15.0 

31-35 

33 

18.  3 

36-40 

28 

15.6 

41-45 

33 

18.3 

46-50 

30 

16.7 

51-55 

11 

6.1 

56  and  over 

8 

4.4 

Total 

180 

100.0 

TABLE  2 

DISTRIBUTIC     JF  SUBJECTS  BY  MARITAL  STATUS 

Status 

N 

Per  cent 

Single 

27 

15.0 

Married 

137 

76.1 

Widows/ 
Widowers 

2 

1.1 

Divorced/ 
Separated 

14 

7.8 

'lotal 

180 

100.0 

TABLE  3 

DISTRIBUTION  OF  SUBJECTS  BY  OCCUPATIONS 


Occupation 

N 

Per  cent 

None 

on 

11  1 

XX*  X 

Mechanical 

18 

10. 0 

Computational 

9 

5.  0 

Scientific 

24 

13.  3 

Persuas ive 

54 

30.0 

Artistic 

5 

2.8 

Literary 

7 

3.9 

Mils  icaX 

0 

0 

Social  Service 

28 

.  15.6 

Clerical 

13 

7.2 

General  Labor 

2 

1. 1 

Total 

180 

100.0 

r»T  CPPT■RTT'PT''^M 
UXO  X  tiXOVJ  XX\JSt 

Income 

N 

Per  cent 

Less  than  $5,000 

15 

8.3 

$5,000  to  $9,995 

51 

28.5 

$10,000  to  $14,999 

42 

23.3 

$15,000  to  $19,999 

32 

17.8 

$20,000  to  $24,999 

L9 

10.6 

$25,000  and  over 

20 

11.1 

Missincr 

1 

0.6 

Total 

180 

100.0 
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TABLE  5 

DISTRIBUTION 

OF  SUBJECTS  BY 

YEAR  OF  ENROLLMENT 

Year 

N 

iPer  cent 

1966 

33 

18.3 

1967 

24 

13.4 

1968 

36 

20.0 

1969 

39 

21.7 

1970 

48 

26.7 

Total 

180 

100.0 

TABLE  6 


CU  a^ii/Vr  STATUS  OF  SUBJECTS  IN  l.iE  PROGRAM 


Status 

N 

Per  cent 

Completed,  obtained  degree 

20 

11.1 

Still  actively  participating 

80 

44.4 

Still  enrolled,  but  inactive 
at  present 

30 

16.7 

Withdrew  from  program 

50 

27.8 

Total 


180 


100.0 
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TABLE  7 

NUMBER  OF  PREVIOUS  CfJIDIT  HOURS 


Credit  Hours 

N 

Per  cent 

None 

• 

50 

27.8 

1-20 

42 

23.3 

21  -  40 

29 

16.1 

41  -  60 

27 

15.0 

61  -  80 

16 

8.9 

81  -100 

10 

5.6 

Over  ;30 

6 

3.3 

Total 

180 

100.0 

DATA  ANALYSIS 

The  data  were  analyzed  using  thd  IBM  370-155  comouter.    The  Alpha 
Analysis  of  Educational  Motivation  Data  was  used  to  deteimine  the  acdquacy 
of  the  70  items  or  reasons  which  appeared  on  the  data-gatherine  instrument. 
Once  the  50  adequate  items  were  deteiu!ned,  a  simple  loading  oblique  rotation 
was  used  to  determine  what  clusters  or  factors  would  emerge • 

Seven  interpre table  factors,  or  clusters,  emerged  from  the  12  factor 
solution.    A  factor  was  considered  tc  be  interpret     '  'f  there  were  at  least 
two  reasons  each  with  a  factor  loading  of  .400  or  greater.    Only  seven  factors 
metwthe  criteria  establisled. 
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The  names  given  to  the  seven  identified  factors  were:    The  Desire 
to  Know;  The  Desire  to  Reach  a  Personal  Goal;   The  Desire  to  Take  Part 
in  Social  Activities;    The  Desire  to  Reach  a  Social  Goa"' ;   The  Desire  to 
Escape;   The  Desire  to  STudy  Alone;   and   The  Desire  fo*  Intel  Tactual 
Security.   Table  8  shows  the  variance  accounted  for  by  ea'Di  of  thfi  seven 
interpretable  factors,  the  variance  accoijnted  for  by  the  five  noriinterpre table 
factors,  and  the  total  variance  of  the  12  factors. 

TABLE  8 

THE  FACTORS  AND  THE  VARIANCE  ACCOUNTliD  FOR 


Factors  Variance 


I. 

The  Desire  to  Know 

21 .8% 

II. 

The  Desire  to  Reach  a  Personal  Goal 

11.4% 

III. 

The  Desire  to  Take  Part  in  Social  Activities 

6.4% 

IV. 

The  Desire  to  Reach  a  Social  Goal 

6.0% 

V. 

The  Desire  to  Escape 

5.2% 

VI. 

The  Desire  to  Study  Alone 

3.8% 

VII. 

The  Desire  for  INtellectual  Security 

2.5% 

Seven  factor  total 

57.15^ 

The  variance  accounted  for  by  five  noninter- 
pretable  factors 

12.2% 

Twelve  factor  total 

69.3% 

To  test  the  hypotheses,  the  following  statistical  tests  and  techniques 
were  used  as  necessary:  t  test,  F  ratio,  INtraclass  correlations,  and  cell 
means. 
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Findings 

There  was  a  significant  difference  found  between  adult  men  and 
women  as  to  motivational  choice  for  enrolling  in  a  directed  self -study 
bachelor's  degree  program,  with  women  showing  a  greater  tendency  than 
men  to  enroll  because  of  the  desire  to  know  a  d  the  desire  to  study 
alone. 

There  was  no  significant  difference  found  between  marital  status 
and  reasons  for  enrolling  in  a  directed  self-study  bachelor's  degree 
program. 

There  was  a  significant  difference  among  age  groups  as  to  reasons 
for  enrolling  in  a  directed  self-study  bachelor's  degree  program,  with  a 
greater  tendency  to  enroll  for  the  desire  to  reach  a  personal  goal  among 
the  younger  respondents. 

There  was  a  significant  difference  found  between  the  employed  and 
unemployed  respondents  as  to  motivational  choices  for  enrolling  in  a 
directed  self-study  bachelor's  degree  program,  with  a  greater  tendency 
among  the  unemployed  to  enroll  for  the  desire  to  reach  a  social  goal. 

There  wa.s  a  significant  difference  between  adults  who  have  had 
previous  college  credit  experience  or  not,  as  regards  motivational 
choices  for  enrolling  in  a  directed  self-study  bachelor's  degree  program, 
with  a  greater  tendency  on  the  part  of  those  who  did  not  have  previous 
credit  course  experience  to  enroll  for  the  desire  to  escape  and  for  the 
desire  to  know.   There  was  no  significant  difference  regarding  motivational 
choices  for  enrolling  on  the  basis  of  the  number  of  previous  college  credits. 

There  was  a  significant  differences  in  choices  selected  for  enrolling 
in  a  directed  self-study  bachelor's  degree  program  by  level  of  income,  with  a 
greater  tendency  to  have  enrolled  for  the  desire  to  reach  a  personal  goal, 
for  the  desire  to  reach  a  social  goal,  and  for  the  desire  to  study  along,  the 
lower  the  level  of  income. 


There  was  no  significant  difference  in  motivational  choices  selected 
by  adults  who  have  withdrawn  from  such  a  program »  or  who  have  completed,  or 
who  are  still  enrolled  but  inactive,  or  who  are  still  actively  participating 
in  a  directed  self -study  bachelor's  degree  program^ 
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A  Methodology  for  the  Development  of  an 
Ideal  Hierarchical  Position-Centric  Role  Model 


The  Extension  Service,  like  many  other  organizations  designed  to 
serve  the  social  needs  of  people,  faces  a  myriad  of  -challenges.  These 
challenges  are  mainly  the  result  of  rapid  societal  change..  Conspicuous 
among  these  is  the  need  to  seek  out  and  test  new  staffing  patterns  to 
facilitate  serving  the  expanding  needs  of  a  contemporary  clientele. 
Shortage  of  professional  staff  and  increasing  demands  from  all  segments 
of  society  lend  urgency  to  this  task.    A  prominent  and  plausible  solu- 
tion, advanced  for  many  of  the  social  work  fields.  Including  the 
Extension  Service,  is  the  use  of  paraprofessionals. 

It  was  in  this  context  that  a  study  was  carried  out  designed  to 
construct  an  ideal  role  model  for  youth  program  assistants.  However, 
the  central  issue  of  this  paper  will  be  to  focus  on  the  research  process 
used  to  develop  an  ideal  hierarchical  position-centric  role  model. 


The  Problem  and  Purpose  of  the  Study 

The  Extension  Service  cannot  rely  on  graduate- level  personnel  to 
fill  all  4-H  -  youth  staff  positions.    Two  factors  are  paramount.  First, 
youth  agents  are  encumbered  with  repetitive  and  routine  tasks  that  do 
not  require  professional  expertise.    This  makes  it  difficult  to  recruit 
and  retain  professionals.    Secondly,  the  great  thrust  to  secure  economic 
adequacy  and  greater  social  participation  for  the  entire  population  has 
made  it  necessary  to  expand  the  efforts  of  the  Extension  Service. 

Organizations  exist  to  accoiiq)lish  certain  goals  and  objectives 
which  are  realized  through  the  interacting  behavior  "of  its  members.  This 
leads  to  the  positions  and  roles  that  must  be  played.    If  one  is  to  add 
a  new  position,  that  of  program  assistant,  then  he  must  become  concerned 
with  the  role  of  the  new  position  in  relation  to  the  existing  positions. 
In  most  Extension  youth  staff  models  this  includes  the  professional  staff 
members  and  volunteer  leaders.    What  is  needed,  then,  is  a  clear  role 
definition  for  each  position  in  the  context  of  a  teamwork  approach  to 
prograiming. 


Presented  by  Dr.  John  A.  Kietow,  Associate  Professor,  Oregon  State 
University  Extension  Service,  Oregon  State  University,  Corvallis,  Oregon 
97331,  at  the  Adult  Education  Research  Conference,  April  1973. 
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The  relationship  then  of  the  youth  agent,  program  assistant  and 
volunteer  leader  In  the  4-H  -  Youth  program  will  be  crucial  to  program 
effectiveness.    They  represent  a  team,  each  contributing  his  part  to 
attainment  of  organizational  goals.    To  accomplish  this  a  clear  deline- 
ation of  the  roles  of  each  team  member  must  be  established.    As  the 
program  assistant  takes  over  more  of  the  old  role  of  the  4-H  agent,  the 
professional  will  become  freer  to  be  Innovative,  to  experiment  and  to 
develop  new  progiams  and  relationships. 

Thus,  a  team  approach  Is  necessary  and  the  youth  agent  must 
hlerarlcally  move  up  In  his  role  tasks,  permitting  the  new  team  member 
(program  assistant)  to  fill  the  void.    This  approach  will  allow  time  for 
Innovations  to  meet  new  program  needs  as  well  as  providing  for  essential 
needs  of  the  volunteers  to  continue  their  Important  function  In  direct 
education  of  youth.  ^ 

In  summary,  the  major  fccus  of  the  study,  from  which  this  research 
process  will  be  reported,  was  the  construction  of  an  Ideal  role  model ^ 
for  the  paraprofesslonal  youth  worker.  I.e.,  the  program  assistant  for 
the  Extension  Service.    Guided  by  role  theory  concepts,  the  model  was 
developed  for  the  program  assistant  as  an  Intermediate  pos    'on.  The 
conceptual  approach  was  to  view  the  position  as  the  middle  position  of 
a  hierarchical  county  and/or  geographic  area  youth  staffing  model  which 
Includes  youth  agents,  program  assistants  and  volunteers.    Basic  to  the 
delineation  of  role  model  tasks  were  the  current  and  prospective  youth 
program  needs  for  an  effective  program  for  the  70 's. 

A  second  purpose  was  to  test  the  model  with  a  limited  number  of 
youth  agents  and  volunteers  In  North  Carolina. 


Background  and  Related  Research 


Due  to  the  newness  of  paraprofesslonals  In  Extension,  It  appeared 
appropriate  to  look  at  several  social  work  organizations  for  Insights 
and  relevant  research  as  a  base  to  guide  the  formulation  of  the  Ideal 
role  model  for  program  assistants.    Objectives  of  this  effort  were  to 
gain  a  general  overview  of  paraprofesslonals,  their  relation  to  program, 
need  for  paraprofesslonals,  methods  of  utilization,  relationships  with 
organizational  workers,  and  Implications  for  organizations. 

This  review  led  the  researcher  to  conclude  that  perhaps  the  most 
productive  and  efficient  way  to  develop  a  job  description  for  program 
assistants  Is  In  terms  of  a  role  theory  approach.    Emphasis  should  be 
placed  on  functions  and  tasks.    This  approach  begins  with  the  agency  and 
Its  goals  and  objectives.    From  there  It  works  downward  to  the  Idtentlfl- 
catlon  of  the  functions  and  Individual  roles  (tasks)  required  to 
Implement  the  agency  program. 


^  The  tasks  that  should  Ideally  be  Included  In  the  role  definition  or 
job  description  of  a  program  assistant. 


3 


One  implication,  already  noted,  is  that  the  role  of  the  program 
assistant  must  be  built  in  relationship  to  other-  roles  and  the  total 
organizational  program  needs*    Further  implications  from  the  review  are 
that  professionals  should  devote  more  of  their  time  to  educational 
activities,  assessment  of  needs,  and  program  supersrLsion.  Program 
assistants  should  be  utilized  to  assist  in  program  expansion  and  outreach 
to  new  audiences.    And  finally,  the  volunteer  should  be  involved  in 
handling  more  of  the  organizational  and  operational  aspects  of  the  youth 
program. 


Conceptual  Frame  of  Reference 

Since  this  study  dealt  with  the  structuring  and  functioning  of  the 
Extension  youth  program  and  the  relationship  of  program  assistants 
working  cooperatively  with  youth  agents  and  volunteers,  role  theory 
provides  a  directive  conceptual  schema  for  analysis. 

A  basic  question  was  whether  the  program  assistant  role  model  be  of 
the  existential  type  (developed  by  the  participants  in  the  social  system)  , 
or  should  it  be  the  constructed  type  (developed  by  the  social  scientists) • 
The  researcher  found  support  for  and  selected  the  latter  typification 
system.    The  rationale  for  this  approach  rests  first  with  the  newness  of 
this  position  and  lack  of  knowledge  by  system  participants.  Secondly, 
rapid  changes  in  an  expanding  and  innovative  youth  program  make  it 
difficult  for  many  participants  to  delineate  a  realistic  role  model  to 
meet  current  program  needs. 

Role  theory  is  based  on. the  assumption  that  individuals  do  not 
behave  in  a  random  manner.    Rather,  they  are  influenced  to  a  high  degree 
by  their  own  expectations  and  of  those  in  the  social  system  in  which 
they  are  participants.    Individual  behavior,  then is  in  large  part  a 
function  of  expectations.    Positions  provide  one  basis  on  which  expec- 
tations may  be  assigned  to  individuals/ 

A  major  advantage  of  role  analysis  is  that  a  search  for  roles, 
counter  roles,  and  expectations  incumbent  on  the  position  of  youth 
program  assistant  can  lead  to  an  orderly  way  to  view  Extensions 's  youth 
program.    This  type  of  study  can  reflect  to  the  investigator  possible 
areas  of  conflict  and  problems  of  interaction. 

In  this  study  the  term  position  was  used  to  denote  the  location  of 
youth  program  staff  at  the  county  and/or  geographic  area.    The  position 
of  program  assistant,  in  relation  to  the  counter  positions  of  youth 
agent  and  volunteer,  served  to  locate  the  actors  in  the  system  of  the 
Extension  youth  program. 

Role  was  defined  as  a  set  of  expectations  applied  to  an  incumbent 
of  a  particular  position.    The  present  investigation  was  concerned  with 
the  delineation  of  functional  tasks  for  the  program  assistants  viewed 
as  a  focal  position.    The  functions  were  derived  from  the  youth  program 
goals,  with  the  role  tasks  for  program  assistant  being  assigned  in 
Q  relationship  to  the  two  counter  positions — youth  agent  and  volunteer. 
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The  concept  of  role  expectations  was  viewed  as  a  logical  approach 
to  guide  the  researcher  in  thinking  about  what  tasks  might  be  appropriate 
for  the  constructed  ideal  role  model.    Role  tasks  were  used  in  the  study 
to  develop  the  activity  that  would  be  expected  in  each  functional  area 
for  the  program  assistant.    The  degree  of  appropriateness  was  studied 
from  the  standpoint  of  the  counter  positions  of  youth  agent  and  volunteer. 

Role  conflict  was  considered  to  guide  the  development  of  a  role 
model  with  a  potential  for  higih  consensus.    Role  consensus  is  essential 
so  the  youth  staff  can  be  of  maximum  service  to  their  clientele. 
Differences  in  consensus  were  used  to  signal  places  where  variability  in 
role  incuinbents'  attitudes,  values,  or  other  personality  characteristics 
may  account  for  different  role  expectations.    In  these  cases  role 
expectations  may  need  to  be  changed,  or  role  incumbents  may  need  additional 
training  so  they  understand  and  accept  the  present  roles  of  the  various 
system  positions. 

The  program  assistant  role  must  be  built  so  the  average  incumbent 
to  this  position  can  learn  to  identify  with  the  role  and  learn  to  perform 
it.    Through  this  learning  process  the  role  occupant's  chance  for  satis- 
faction in  the  role  will  be  enhanced^  and  organizational  effectiveness 
will  be  increased. 

Of  special  importance  to  this  analysis  was  the  fact  that  a  parti- 
cular position  has  two  cispects  which  must  be  considered.    These  are: 

1.  The  relational  specification  of  positions c 

2.  The  situational  specification  of  positions. 

For  this  stucfy  a  hierarchical  position-centric  model  was  used  in  the 
development  and  analysis  of  the  program  assistant  role  models  This 
model  included  youth  agent,  program  assistant,  and  volunteer  as  diagramed 
in  Figure  1. 

The  researcher  developed  the  position  of  program  assistant  as  the 
second  position  in  the  hierarchical  youth  program  staff  model.  The 
rationale  was  to  hold  the  volunteer  position  at  its  present  level,  moving 
the  youth  agent  upward  in  the  hierarchy.    The  program  assistant  will 
fill  the  intermediate  position.    This  approach  appears  valid  due  to  the 
increased  role  tasks  in  the  youth  program. 

Essentially  the  employment  of  program  assistants  will  add  a  new 
hierarchical  level,  as  well  as  create  a  new  position*  Therefore, 
differences  in  expectations  must  be  identified  and  efforts  made  to 
resolve  them  if  program  assistants  are  to  make  maximum  contributions 
toward  organizational  goals.    Effectiveness  can  be  greatly  increased 
when  each  position  occupant  knows, unde rs t ands ,  and  accepts  his  role  and 
the  roles  of  those  with  whom  he  interacts. 
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COUNTER  POSITION  NO.  1 
(Youth  Agent) 


FOCAL  POSITION 
(Program  Assistant) 


COUNTER  POSITION  NO*  2 
(Volunteer) 


Figure  1.    Position-cent rlc  inodel  for  youth  program  assistant 

(Adapted  from  model  developed  by  Gross^  1958,  p.  54) 


Research  Process 


Six  major  procedural  steps  were  employed  In  the  development  and 
testing  of  the  Ideal  role  model.    These  steps  will  be  described  briefly 
below  and  some  samples  of  Instruments  used  presented  to  further  amplify 
the  research  process  used  In  this  study. 

Step  1 

The  first  goal  of  the  researcher  was  to  establish  a  base  for  a 
viable  youth  program  In  the  70 *s.    This  was  done  by  reviewing  key  reports 
which  project  current  and  potential  Extension  youth  program  needs.  Of 
special  Interest  were  Extension  role  studies  that  have  developed  job 
descriptions  and  roles  of  youth  agents  and  volunteers. 

In  addition,  because  of  the  newness  of  this  position  to  Extension, 
It  was  reasoned  that  a  review  of  paraprofesslonal  Involvement  In  other 
social  work  fields  would  be  helpful.    An  ERIC  search  was  run  using 
relevant  descriptors  and  those  citations  which  had  promise  of  yielding 
supporting  information  were  reviewed.    Much  of  the  New  Careers  literature 
was  included. 

This  action  accomplished  two  research  tasks.    First,  it  helped  the 
researcher  finalize  his  research  process,  and  secondly,  it  identified 
many  potential  tasks  for  the  new  position  of  program  assistant. 


ERIC 


2  Gross,  N.,  W.  S.  Mason  and  A.  W.  McEachem.    1958.    Exploration  in 
Role  Analyses  Studies  of  the  School  Superlntendency  Role.    John  Wiley  and 
Sons^  Inc.,  New  York,  New  York. 
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Step  2 

To  gain  concrete  data  regarding  actual  roles  of  prcgram  assistants, 
the  4-H  -  Youth  Division  of  the  Extension.  Service^  USDA,  was  contacted 
for  assistance.    The  researcher  spent  a  week  in  Washington,  D.C., 
reviewing  studies  and  interviewing  staff  regarding. programming  and 
staffing.    A  survey  made  during  1971  had  indicated. that  1,986  4-H  aides 
had  been  utilized  in  1970  4-H  programs.    Arrangements  were  made  for  the 
researcher  to  have  some  in  depth  interviews  in  West  Virginia,  where 
program  assistants  were  being  utilized. 

An  interview  schedule  (see  Sample  A)  was  developed  to  assist  in 
collection  of  information  for  task  analysis.    Supported. by  the  publica- 
tion. Task  Analysis,^  which  was  sponsored  by  the  New  Careers  Training 
Laboratory,  an  effort  was  made  to  look  at  the  roles  played  by  youth 
agents,  program  assistants,  and  volunteers  "as  now  exists"  and  "as  should 
be"  if  they  could  operationalize  the  program  as  they  thought  it  should 
be.    In  each  county  visited  all  three  position  occupants  were  interviewed 
i.e.  agents,  program  assistants,  and  volunteers.    Twenty-one  interviews 
were  completed. 

Step  3 

From  the  above ^outlined  steps  the  researcher  developed  and  listed 
approximately  300  potential  tasks  that  could  be  a  part  of  a  county  youth 
program  worker's  job.    Criteria  growing  out  of  literature  reviews  guided 
the  work  of  selecting  tasks  appropriate  for  program  assistants.  These 
criteria  were  as  follows: 

1.  That  the  Extension  Service  must  have  a  dynamic,  relevant  and 
flexible  youth  education  program  geared  to  helping  youth  reach  their 
serious  developmental  needs  in  today's  society. 

2.  That  professional  staff  must  consider  their  first  priority 
audience — youth  program  assistants  and  volunteers — who  are  trained  to 
carry  out  educational  activities  with  the  members. 

3.  That  youth  program  assistants  will  work  under  the  supervision 
of  the  county  and/or  geographic  area        -  Youth  development  agent. 

4.  That  task  analysis  is  a  valid  and  systematic  way  of  determining 
functions  and  tasks  included  in  a  given  job  or  position. 

5.  That  a  task  is  a  separate  and  distinct  part  of  a  function  requir 
ing  some  activity  (physical  or  mental)  related  to  a  specific  purpose. 
That  to  the  extent  possible  tasks  will  be  described  in  behavioral  terms 
to  more  clearly  depict  what  activity  is  to  be  performed  to  accomplish  the 
task. 


3  Jackson,  Vivian  C.    1971.    Task  Analysis;    A  Systematic  Approach  to 
Designing  New  Careers  Programs.    New  Careers  Training  Laboratory,  New 
York  University,  New  York. 
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6.  That  it  is  necessary  to  identify  tasks  essential  to  conduct  a 
4-H  -  Youth  program  for  county  and/or  geographic  areas,  and  then  assign 
role  tasks  to  youth  agent,  program  assistant  and  volunteer  based  on 
these  three  positions  of  workers — working  as  a  team  to  provide  leader- 
ship for  the  total  youth  program. 

7.  That  the  program  assistant  role  model  must  be  a  realistic 
description  (most  program  assistants  can  perform  or  readily  learn  to 
perform)  ,  recognizing  there  will  be  a  wide  variation  in  background  and 
entry  level  skill. 

8.  That  role  tasks  will  need  to  be  written  at  a  specific  level, 
recognizing  respondents  will  be  asked  to  evaluate  the  appropriateness  of 
the  tasks.    Thus,  the  role  model  will  not  be  exhaustive,  but  rather  will 
be  limited  to  a  representative  sample  of  critical  tasks. 

9.  That  most  of  the  tasks  are  seen  as  lying  on  a  continuum.  All 
three  positions  of  workers  may  relate  to  the  same  task,  but  at  various 
levels. 

10.    That  the  role  model  must  provide  for  a  viable  position  that  can 
yield  job  satisfaction  to  the  role  incumbent. 

Another  procedure  used  in  developing  the  ideal  tasks  was  the 
development  of  functional  categories  for  the  role  model.    A  function  was 
defined  as:    A  group  of  tasks  which  are  similar  in  nature.    When  the  job 
description  is  expressed  in  behavioral  terms  the  subject  matter  within  a 
functional  area  may  change,  but  the  behavior  will  be  similar.    A  function, 
therefore,  may  ^'nclude  several  individual  tasks. 

The  functional  categories  used  for  the  present  study  were  based  on 
a  conceptual  schema  for  planning,  implementing  and  evaluating  task-oriented 
organizations  that  function  in  a  voluntary  setting  (Boone  et^  al.).^  The 
functions  and  their  definitions  are  listed  below. 

Maintenance — Activity  directed  toward  the  support,  supervision  and 
renewal  of  the  organization. 

Needs — Activity  directed  toward  needs  identification  and  analysis 
related  to  target  audience. 

Planning — Activity  directed  toward  decision  making  in  selection  of 
objectives  and  organizing  learning  activities. 

Execution— Activity  directed  toward  iraplementing,  mobilizing,  and 
monitoring  the  teaching  learning  process. 

Evaluation — Activity  directed  toward  measuring  the  effectiveness  of 
the  programming  function  in  bringing  about  change. 


^  Boone,  E.  J.,  R.  J.  Dolan  and  R.  W.  Shearon.     1971.    Programming  in 
the    Cooperative  Extension  Service:    A  Conceptual  Schema.    Misc.  Extension 
y  Publication  72,  The  North  Carolina  Agricultural  Service,  Raleigh,  North 

fclyC  Carolina. 
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Applying  the  above  criteria  and  using  the  functional  categories,  the 
researcher  selected  81  tasks  and  In  a  second  review  narrowed  the  model  to 
61  tasks.    Developing  Job  and  Position  Descriptions  In  the  Cooperative 
Extension  Service  (Lavery  et  al^. ,  1965)  was  most  helpful  In  the  final 
writing  of  tasks.    The  tasks  were  written  with  action  verbs  which  would 
connote  the  behavioral  activity  needed  to  carry  out  the  task.    This  was 
done  In  order  to  facilitate  putting  tLe  tasks  Into  a  completed  job 
dlscrlptlon  which  could  be  made  even  more  specific  by  quantification. 

Step  4 

In  an  effort  to  further  Improve  the  role  model,  a  selected  panel 
of  15  members  were  asked  to  rate  each  task  as  acceptable,  or  not  accep- 
table, using  a  specially  designed  evaluative  Instrument  (see  Sample  B) . 
Also  the  panel  rated  the  functional  assignment  of  each  task.  These 
ratings  were  done  after  careful  orientation  was  given  to  the  entire  panel 
regarding  the  researcher's  theoretical  base,  criteria,  and  functional 
category  definitions. 

Validity  was  substantially  enhanced  by  the  use  of  the  panel,  which 
was  made  up  of  Extension  staff  and  adult'  educators  from  national  to  county 
level.    Included  were  administrators,  educators  and  program  specialists. 
County  workers  included  Extension  agents,  volunteers  and  nutrition  aides. 
With  panel  assistance,  a  50  task  model  was  developed  which  was  felt  to 
provide  an  adequate  representative  sample  of  the  critical  tasks  in  each 
of  the  five  functional  categories. 

Step  5 

Following  the  development  of  the  constructed  ideal  role  model,  the 
tasks  were  used  in  the  development  of  a  mail  questionnaire  for  the  pur- 
pose of  testing  appropriateness  of  tasks — as  viewed  by  youth  agents  and 
volunteers.    When  respondents  marked  a  response  as  inappropriate,  they 
were  then  asked  to  indicate  to  whom  they  would  assign  the  task,  (see 
Sample  C) 

Step  6 

Responses  were  machine  tabulated  to  determine  relative  importance 
assigned  to  each  task  in  total  and  by  positional  group.    The  major 
objective,  however,  was  to  determine  degree  of  consensus  on  role  model 
tasks  between  youth  agents  and  volunteers.    Interpositional  consensus  was 
also  studied  by  functional  category.    A  further,  check  was  made  to  deter- 
mine if  the  variables  of  tenure,  education,  size  of  program,  or  location 
(rural  or  urban)  would  influence  degree  of  consensus  within  a  positional 
group . 


Findings 


In  general,  tasks  were  assigned  a  high  degree  of  relative  Importance 
for  the  50  task  Ideal  role  model.    Respondents,  based  on  a  combined  mean 
score,  rated  the  tasks  4.10  on  a  five  point  Llkert-type  scale.  Analysis 
by  positional  group  showed  that  youth  agents  had  a  mean  score  of  4.05  for 
all  tasks,  contrasted  to  a  total  mean  score  of  4.15  for  volunteers.  This 
similarity  of  rating  demonstrated  a  high  level  of  consensus  on  relative 
Importance  and  strong  support  for  the  overall  role  model  as  being  appro- 
priate for  program  assistants. 

There  was  no  significant  difference  between  respondent  groups  jn 
degree  of  consensus  on  the  importance  of  39  out  of  the  50  tasks  studied. 
Fifteen  percent  of  the  respondents  felt  that  eight  of  the  tasks  should 
not  be  a  part  of  the  role  model.    When  tasks  were  grouped  and  summed  by 
functional  category,  there  was  a  low  degree  of  consensus  between  respon- 
dents on  relative  importance  in  all  but  the  maintenance  category.  The 
selected  variables  of  education,  tenure,  size  of  program  and  location 
exhibited  negligible  association  with  degree  of  consensus. 


Conclusions  and  Implications 


A  role  study  for  a  new  organizational  position  has  great  pragmatic 
value  for  organizational  goal  attainment.    Cooperation  and  .tlveness 
among  workers,  in  a  large  part,  are  dependent  upon  an  under        ling  and 
acceptance  of  the  roles  of  each  organizational  member.    Moreover,  role 
expectations  must  be  congruent  with  overall  organizational  goals  if  an 
organization  is  to  achieve  a  viable  program.    Role  analysis  is  seen  as  a 
useful  orientation  to  the  study  of  expected  behavior  of  a  particular 
position  in  the  Extension  organization.    It  was  found  that  expectations 
can  be  studied,  analyzed  and  described  in  terms  of  tasks. 

Building  an  ideal  role  model  for  a  new  positional  group  of  workers, 
i.e.,  researcher  built  as  opposed  to  expectations  of  present  organiza- 
tional workers,  is  one  efficient  way  to  work  toward  institutional  change. 
To  the  extent  that  tasks  for  new  positions  are  based  on  thet  contemporary 
needs  of  an  organization,  this  procedure  is  especially  valid. 

A  role  model  that  has  been  constructed  and  tested  for  a  new 
organizational  worker  can  have  many  implications.    Every  organizational 
position  exists  in  relationship  to  other  organizational  positions.  There- 
fore, when  new  positions  are  added,  an  organization  must  make  appropriate 
adjustments.    This  will  be  especially  true  when  the  new  worker  will  change 
the  traditional  hierarchical  structure,  as  will  be  the  case  for  the  youth 
program  staff  model  when  the  program  assistant,  intervenes  between  youth 
agent  and  volunteer.    In  this  study  it  was  evident  that  youth  agents  did 
not  agree  with  volunteers  on  tasks  that  would  have  program  assistants 
working  in  direct  relationship. with  volunteers.    One  may  conclude  that 
youth  agents  desire  to  maintain  direct  relationships  with  the  volunteers. 
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xhia  role  model  for  program  assistants  can  help  identify  required 
positional  qualifications,  direct  pre-induct ion.  orientation  and  on  the 
job  training,  aid  in  job  supervision,  provide  a  basis  for  writing  job 
descriptions,  \mdergird  the  development  of  county  youth  staffing  models, 
and  serve  to  guide  evaluation  of  current  youth  programs  where  program 
assistants  are  employed. 

The  functional  task  development  approach  used,  to  develop  an  ideal 
role  model  for  program  assistants  in  this  study  may  be  useful  in  studying 
this  position,  or  other  positions,  in  other  states.    Also,  the  findings 
may  be  helpful  to  all  staff  members  as  they  form  expectations  for 
Extension  program  assistants.    It  also  cen  be  concluded  from  the  analysis 
of  taslcs  by  functional  category  that  the  program  assistant  role  was  seen 
as  appropriate  in  all  aspects  of  the  organizational  life  of  the  youth 
program. 


This  paper  is  based  on  an  Extension  Service,  USDA,  Special  Project 
Report  and  doct  ral  dissertation,  entitled,  "Role.  Model  for  the  Para- 
professional  Youth  Worker  in  the.  Extension  Service,"  completed  at  Nort*^ 
Carolina  State  University,  under  the  direction  of  Drs.  Jerry  Parsons  and 
Curtis  Trent,  Department  of  Adult  and  Community  College  Education.  The 
study  was  completed  in  cooperation  with  the  U.S.  Department  of  Agriculture 
and  the  Office  of  4-H,  Agricultural  Extensiop  Service,  North  Carolina 
State  University. 


Sample  A«    Role  of  the  Paraprofessional  Youth  Worker  In  the  Extension 


Service 


INTERVIEW  SCHEDULE 

Demographic  Data 

!•    County  or  State  

2.  Agent   Aide   Leader  

3.  Age  yrs*  4.    Tenure  yrs. 

5.  Rural   Urban   Coinblnatlon  

6.  Experience  In  4-H  -  Youth  Work  yrs. 

7.  Race   

8.  Marital  Status:    Married  Unmarried  

9.  Number  of  Children  

10.  Education:    High  School   College  

Years  Type  Degree   

11.  Size  of  A-H  program  (number  of  4-H  members) 

12.  Number  of  organized  community  clubs  

13.  Prior  Experience  (work  or  volunteer) 

Role  Definitions 

1.  What  do  you  do  In  the  4-H  -  Youth  Program? 

2.  What  does  Agent — Aide — Leader  do?    (Describe  two  which  apply) 

3.  What  do  you  think  the  role  of  Agent — Aide — Leader  should  be? 


t 
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Sample  B>    Panel  Evaluation  Form 


(A  Partial  Sample) 


Tasks 

1  r 

A 

- 
E 

C 

1 

CODE: 

A  «  Task  Appropriateness 

B  «  Task  Assignment 

C  ^  Task  Functional  Assignment 

Acceptable 

Not  Acceptable 

Program  Assistant  . 

Program  Aide 

Acceptable 

Questionable  1 

Should  Be  Assigned  To: 

1.    Acts  as  a  liaison  person 
between  the  4^H  program 
and  the  community  and/or 
county. 

21.    Assists  4-H  -  Youth  devel- 
opmenc  agencs  xn  uecezmxn^ 
ing  program  objectives. 

41.    Assists  communities  in 

selection  o£  project  lead-- 
ers»  activity  leaders  and 
junior  leaders  needed  by 
the  club. 

61.    Confers  with  4-H  -  Youth 
development  agents  on 
progress »  problems  and 
results. 

ERIC 
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Sample  C.  Questionnaire 

(A  Partial  Sample) 


INSTRUCTIONS 

On  the  following  pages  Is  presented  a  suggested  set  of  work  tasks 
that  could  be  a  part  of  the  youth  program  aide's  Job  description. 

Numbers  on  the  scale  following  each  task  statement  In  the 
questionnaire  have  the  following  rating* 

5       Very  Appropriate  —  an  essential  part  of  the  aide's  Job 

4       Somewhat  Appropriate  —  probably  should  be  a  part  of  the  aide's  Job 

3       Undecided  —  may  or  may  not  be  a  part  of  the  aide's  Job 

2       Somewhat  Inappropriate  —  probably  should  not  be  a  part  of  the 
aide's  Job 

1       Very  Inappropriate  —  definitely  should  not  be  a  part  of  the  aide's 
Job 


Please  circle  only  one  number  to  Indicate  your  feeling  on  the 
appropriateness  of  each  task  for  the  youth  program^  aide.    Be  sure  you 
circle  one  nuiaber  for  each  separate  task.    If  you  circle  Very 
Inappropriate,  number  1  for  the  task,  then  also  check  In  the  next 
column  Indicating  who  you  would  assign  the  task  to  —        Agent  or 
4-H  Volunteer  Leader.    Check  In  this  colusm  only  If  you  circle  number  1. 


YOUTH  PROGRAM  AIDE  JOB  DESCRIPTION 


1.  Assists  47H  Youth  Agents  in  evaluating 

county  activities.  5  4  3  2  1 

2.  Serves  as  a  public  relations  person 
fcfor  the  4-H  Youth  program  and 

*extenslon.  5  4  3  2  1 


6 
00 

< 


(  ) 


(  ) 
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3.  Counsels  with  4-H  volunteer  leaders 
on  how  to  work  with  parents  and 

other  leaders.  5  4  3  2  1 

4.  Understands  Immediate  and  long  range 
program  goals  and  assists  4'-H  volunteer 
leaders  In  planning  local  youth  programs 
t:o  provide  learning  experiences  to  help 

youth  reach  these  goals.  5  4  3  2  1 


(  ) 


(    )       (  ) 


AN  ANALYSIS  OF  THE  NEED  AND  FORM  FOR 
COMPREHENSIVE  ADULT  EDUCATION  ASSOCIATIONS 


Lloyd  J,  Korhonen  —  Department  of  Administration  and  Supervision 

The  University  of  Wisconsin-Milwaukee 

The  growth  of  professional  association  within  a  discipline  can  be 
used  as  a  measure  and  descriptor  of  the  grov/th  of  the  profession 
itself.    This  growth  can  take  a  variety  of  forms,  chief  among  them 
being  growth  in  numerical  strength  of  its  association  or  associations, 
growth  tn  number  of  separate  associations^  or  growth  in  the  variety  of 
activities  that  are  classified  within  the  profession  and  acknowledged 
within  its  association  or  associations. 

It  has  been  my  observation,  through  over  seven  years  of  work  in 
the  field  of  adult  education,  that  no  one  organization  has  generated 
enough  common  interest  among  adult  educators  to  generate  their  continu- 
ing support.    This  perception  was  reinforced  during  the  past  two  years 
of  my  involvement  v;ith  Project  ENABEL,  an  adult  basic  education 
teacher  training  project  at  Michigan  State  University.    Each  of  the 
SIX  states  in  U.S.O.E.  Region  V  has  developea  associations  of  adult 
educators.     In  none  of  the  states,  however,  has  there  emerged  a 
comprehensive  adult  education  association  that  is  supported  by  the 
entire  field  of  adult  education  to  any  significant  degree. 

The  adult  education  movement  In  the  United  States  has  historically 
been  a  fraqmented  movement. 
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There  are,  perhaps,  a  dozen  professional  associations  in 
which  adult  education  workers  associated  with  agencies 
primarily  devoted  to  adult  education  are  grouped  accord- 
ing to  the  type  of  Institution  they  work  In.  Examples 
Include  the  National  University  Extension  Association, 
the  National  Association  of  County  Agents,  the  National 
Association  of  Public  School  Adult  Educators,  the 
Association  of  University  Evening  Colleges,  the  Adult 
Education  Division  of  the  American  Library  Association, 
and  the  American  Association  of  Junior  Colleges.  These 
associations  are  concerned  primarl 1 y  wi th  advancing  their 
own  institutional  programs,  but  secondarily  with  their  role 
in  the  general  adult  education  movement.    They  tend  to 
encompass  the  bulk  of  the  people  who  see  themselves  making 
their  careers  In  adult  education. 

To  these  organizations  can  be  added  the  National  Community  School 

Education  Association,  the  National  Council  on  Community  Services  for 

Junior  and  Community  Colleges,  and  many  associations  of  private  and 

publ ic  groups. 

The  numerical  strength  of  the  adult  education  movement  is  impossi- 
ble to  state  precisely.    Johnstone  and  Rivera,  In  a  study  published  in 
1965»  found  that  twenty-five  million  adults  (about  one  person  In  every 
five  in  the  United  States)  v/ere  Involved  in  adult  education.    This  same 
study  reported  that  16,500,000  adults  were  enrolled  In  regular  continu- 
ing education  courses  sponsored  by  Institutions  with  the  United  States 
2 

in  1962.      Cyril  Houle,  in  his  book  The  Design  of  Education >  enumerates 
seven  learning  modes  for  adult  learners  utilized  by  Individuals  and 
institutions  In  adult  education. 


Gale  Jensen,  A.  A.  Liverright,  and  Wilbur  Hallenbeck,  eds.. 
Adult  Education — Outlines  of  an  Emerging  Field  (Adult  Education 
Association  of  the  U.S.A.,  196^),  p.  63. 

^John  W.  C.  Johnstone  and  Ramon  J.  Rivera,  Volunteers  for  Learn- 
ing:   A  Study  of  the  Educational  Pursuits  of  American  Adu I ts  (Chicago; 
Aldine  Publishing  Co.,  1965),  Adapted  from  Table,  p.  61. 

"^Cyril  0.  Houle,  The  Design  of  Education  (San  Francisco:  Jossey 
Bass,  Inc.,  1972),  pp.  90-128. 


This  great  scope  within  the  adult  education  enterprise  makes  it 
extremely  difficult  to  mount  a  successful  organization  of  general 
Interest  to  all  adult  education.    At  the  same  time,  however,  the 
diffused  nature  of  the  field  gives  rise  to  the  necessity  for  a  single 
generalized  organization  at  state  and  national  levels  if  the  pro- 
fession is  to  be  recognized  in  its  totality. 

Adult  education  in  this  country  needs  a  generalized 
national  organization  of  maximum  inclusiveness  in  terms 
of  the  content  and  organized  structure  of  the  field  .  .  . 
in  the  present  state  of  our  society  and  of  adult  education, 
the  AEA  seems  essential.^ 

Whether  the  present  Adult  Education  Association  fills  the  need 
for  a  generalized  adult  education  association,  or  If  another  associa- 
tion should  arise  to  fill  this  need  is  really  not  the  question.  The 
need  exists  and  will  continue  to  exist.    An  effective  generalized 
association,  in  the  opinion  of  most  students  of  voluntary  and  pro- 
fessional associations,  v/ill  become  the  growth  organization. 

At  the  present  time  the  Adult  Education  Association  of  the  U.S.A. 
Is  endeavoring  to  fill  this  need.     Founded  in  1951  the  AEA  was 
initiated  with  these  purposes: 

1.  To  bind  volunteer  and  professional  workers  into 
0  fellov/ship  dedicated  to  improving  their  competencies  as 
adul  t  educators. 

2.  To  establish  lines  of  communication  for  joint 
planning  and  sharing  of  experience  between  individuals 
and  organizations  engaged  in  Adult  Education. 

3.  To  acquaint  the  general  public  with  the  needs 
and  opportunities  for  Adult  Education  and  to  stimulate 
greater  support  for  it. 5 


Edmund  de  S.  Brunner,  "Report  to  the  Adult  Education  Associa- 
tion'' (Bureau  of  Applied  Social  Research,  I960),  p.  1. 


•^Malcolm  S.  Knowles,  ''How  the  Adult  Education  Association  Works,'* 
Adult  Leadership,  M,  No.  2  (April,  195^)  t  5. 


In  order  to  develop  a  strong  national  association,  the  development 
of  strong  state  associations  is  necessary.    As  stated  by  Edmund  de  S. 
B  runner: 

The  strongest  volunteer  agencies  are  those  with  strong 
local  organizations  and  ties  and  these  exist  only  where 
such  relationships  are  cultivated  and  mutually  profitable.^ 

The  state  of  Michigan  is  unique  emong  the  states  in  its  history 
In  adult  education  activity.    All  the  major  associations  of  adult 
education  are  represented  within  the  state.     It  has  had  a  leadership 
role  In  both  university  and  cooperative  extension,  In  public  school 
and  library  adult  education,  in  worker  education,  In  education  for 
women,  and  in  many  other  sectors  of  adult  and  continuing  education. 
Michigan  has  also  led  the  way  in  the  development  of  new  associations 
as  Is  Illustrated  in  two  of  the  newest  of  the  national  associations. 
The  National  Community  School  Education  Association  was  chartered  In 
Flint,  Michigan  and  the  founding  of  the  National  Council  on  Community 
Services  for  Junior  and  Community  Colleges  was  led  by  university  and 
community  college  workers  In  Michigan.    During  Its  first  twenty  years 
the  AEA-USA  has  drav;n  six  of  Its  presidents  from  Michigan,  and  two  pf 
Its  twenty  annual  conventions  have  been  held  In  Michigan. 

The  Adult  Education  Association  of  Michigan  was  founded  In  195^t 
three  years  after  the  chartering  of  the  Adult  Education  Association  of 
the  U.S.A.    At  the  present  time  the  state  association  Is  experiencing 
many  of  the  same  concerns  expressed  at  the  national  level.     It  is 
presently  examining  Its  role  and  trying  to  redefine  Its  relationships 
to  adult  education  and  to  the  various  specialized  adult  education 
associations.    The  problem  of  role  definition  Is  especially  difficult 


for  this  association  which,  by  original  design  and  continuing  Intention, 
Is  concerned  with  the  total  field  of  adult  education,.   At  the  same  time 
as  other  associations  define  and  redefine  their  memberships  to  narrower 
and  narrower  limits,  the  need  for  the  Integrating  and  unifying  Influ- 
ence of  a  comprehensive  state  adult  education  association  serving  the 
total  field  becomes  increasingly  apparent. 

The  Problem 

The  problem  for  this  research  has  been  to  assess  what  Is  desired 
by  representative  adult  educators  of  one  or  more  state  adult  education 
associations.     It  has  sought,  further,  to  answer  the  question,  if. 
Indeed,  there  are  needs  not  now  being  met  by  the  Adult  Education 
Association  of  Michigan,  how  can  the  structure  of  the  association  be 
adjusted  to  permit  satisfaction  of  these  needs  and  to  justify  its 
continuing  as  a  comprehensive  association?    The  general  operational 
problem  In  this  research  have  been  to  assess  what  adult  educators 
desire  of  state-wide  associations. 

Objectives  of  the  Study 
The  objectives  of  this  study  have  been  to  assess  what  Is  desired 
of  comprehensive  state  adult  education  associations  by  respondent 
adult  educators* 

1,  Identify  whether  there  does  exist  among  AEA-M  officers  and 
members  and  among  other  adult  educators  who  might  be  expected 
to  become  members,  a  perceived  need  for  a  comprehensive  state 
adult  education  association. 

2,  Identify  the  organizational  goals  as  perceived  by  rank  and 
file  hfembers  within  the  association. 


3.  Identify  the  organizational  goals  as  perceived  by  persons  who 
might  be  expected  to  become  members  but  are  .currently  outside 
of  the  association. 

Predict  which  specific  organizational  goals  will  or  will  not 
foster  broad  concensus  among  adult  educators. 
5.     Identify  internal  factors  that  need  to  be  adjusted  in  order  to 
satisfy  goal  expectations  of  association  members,  present  and 
former  officers,  and  persons  optstde  the  association  that  are 
potential  members* 

Assumptions 

The  three  major  assumptions  of  this  study  are: 

K    There  are  factors  within  a  voluntary  association  that,  when 

properly  developed  and  related,  will  lead  to  maximum  achieve- 

ment, 

2.  There  is  a  broad  range  of  goals  for  a  comprehensive  adult 
education  association  which  are  held  in  comrrwn  by  adult 
educators  in  spite  of  their  differences  in  function  and  role. 

3,  These  same  goals  are  held  In  common  by  adult  educators 
whether  or  not  they  are  currently  members  of  the  association. 

Research  Methodology 

The  Research  Designed  was  an  empirical  analysts  of  opinions  of  a 

] 

wide  variety  of  adult  educators,  both  members  and  non-members  of  this 
Association  and  others. 

Data  were  obtained  by  using  a  mailed  questionnal  re.    This  allowed 
a  broad  coverage  and  involvement  on  the  part  of  730  adult  educators 
in  five  selected  groups. 


Assumptions 

Three  interrelated  assumptions  were  made  as  dirfec*'ly  related  to 
association  effect lveness#    These  assumptions  plus  the  theoretical 
propositions  constituted  the  conceptual  foundation  for  this  investiga- 
tion. 

1.    The  degree  to  which  organizational  goals  will  be  actively 

pursued  Is  directly  related  to  the  extent  to  which  these  goals 
are  perceived  as  Important  by  members  of  the  association, 

2»    The  degree  to  which  an  organization  will  be  effective  Is 
directly  related  to  the  extent  to  which  Its  goals  are  per- 
ceived as  Important  by  members  of  the  profession  outside  the 
Association* 

3.    The  degree  to  which  an  organization  will  be  effective  is 

directly  related  to  the  degree  of  consensus  anr)0ng  Its  members 
as  to  Its  goals* 

Analytical  Framework  for  the  Study 

Factors  analyzed  in  the  study  have  been  organized  Into  six  cate- 
gories: 

(1)  in  terorqani  rational  re  1  at  Ion  ships— the  relationship  between 
organizations  for  adult  educators  and  the  present  or  possible 
structure  of  that  relationship. 

(2)  Int  raorqanlzational  rel  at  ion  ships— the  present  and  possible 
Internal  relationships  and  the  structure  and  practices  of  an 
organization  for  shaping  those  relationships* 

(3)  Communication-- the  present  and  possible  modes  of  communication. 
This  Includes  communication  between  organizations,  within  organ- 
izations, with  the  field  as  a  totality,  and  v/lth  specific  and 
general  publics* 


(^)  Association  $ervlces-*the  present  and  potential  services  which 
an  organization  of  adult  educators  provldesor  should  provide 
to  the  field  of  adult  education  or  to  its  members. 

(5)  Professional  standards**the  present  and  potential  standards 
for  Identifying  professional  members  and  guiding  professional 
conduct  in  the  adult  education  enterprise. 

(6)  Legislative  BCtion— the  present  and  potential  activities  of 
adult  educators  or  their  association  to  influence  legislation 
or  the  functioning  of  governmental  agencies  at  any  level. 

Population  Surveyed 

Five  discrete  groups,  including  730  adult  educators,  were  surveyed. 
Each  of  the  groups  was  selected  because  it  represented  a  significant 
sector  of  the  total  population  of  adult  educators.    The  Adult  Education 
Association  (designated  AEA-M)  was  open  to  persons  who  worked  or  were 
interested  in  any  field  of  adult  education.    The  Michigan  Association 
of  Public  Adult  and  Community  Education  (designated  MAPACE)  was  open 
to  two  specific  groups  of  adult  educators,  administrators  of  public 
school  adult  education  and  directors  of  community  school  programs.  Its 
membership  had  consisted  historically  and  predominantly  of  the  former. 
Tho  ENABEL  cxterns,  a  group  of  teachers,  administrators  and  counselors 
(predominantly  teachers)  In  adult  basic  education,  represented  a  group 
who  had  recently  become  engaged  in  adult  basic  education  and  for  whom 
no  special  association  existed  in  the  state.    The  members  of  the  Michigan 
Library  Association  represented  a  group  that,  at  one  period,  was  quite 
active  within  the  adult  education  association,  but  had  since  lost 
essentially  all  of  their  contact  with  It.    The  other  selected  groups 
represented  Individuals  engaged  in  adult  education  for  special  audiences 
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and  who  were  generally  not  connected  with  any  adult  education  association 
at  the  time  of  the  study* 

The  population  survey  included  members  of  these  five  major  groups 
all  Involved,  and  together  reasonable  representative  of  the  interest, 
statewide,  in  the  adult  education  enterprise. 


Association 


AEA-H 


MAPACE 


ENABEl  State  Externs 


Selected  adult  educators 
not  generally  Identified 
with  PubHc  Adult  Education 


Nature  of  Membership 

Alt  segment  of  the  adult 
education  enterprise 

Public  school  adult  edu- 
cation and  community  edu- 
cation directors 

Publ Ic  and  private 
librarians  of  Michigan 

Teachers,  counselors,  and 
administrators  of  adult 
basic  education 

Police  training,  medical 
training,  government 
(municipal,  county,  and 
state),  church  adult  edu- 
cation groups,  business 
training,  and  volunteers 
In  cooperative  extension. 


Analysis  of  Responses 

The  quantitatively  expressed  responses  of  each  respondent  were 
recorded  on  IBM  Data  Processing  Cards*    Data  were  analyzed  with  the  use 
of  a  COC  6500  computer*    An  ACT  program,  number  T*R.  72-8,  authored  by 
Leighton  A,  Price  and  William  P.  O'Harc  of  the  Social  Science  Research 
Computer  Institute  at  Michigan  State  University  was  utilized.  ACT 
yields  contingency  tables  (btvarlate  frequency  distributions)  for 
designated  pairs  of  variables.    The  paired  variables  utilized  In  this 
study  are  the  groups  In  which  respondent  is  Included  and  their  o;jantt- 

tatlvely  expressed  responses. 


ERIC 


Reporting  Format 

The  results  were  reported  utiUztng  six  measures*    The  measures 
of  central  tendency  v/ere:    mean  scores  for  all  ri-spondents  to  each  of 
the  Items,  variance  of  the  means,  and  standard  deviation*  Standard 
deviation  was  utilized  as  an  indicator  of  variance  for  the  mean  score 
as  well  as  an  indicator  of  across  group  differences.    Two  separate  means 
and  standard  deviations  were  reported,  individual  group  means  and 
standard  deviations,  and  total  mean  and  standard  deviation  for  each 
item. 

Contingency  Table  Output 

The  contingency  tables  were  reported  utilizing  the  following 
format: 

Responses 
12  3^ 

Groups 
I 
2 

3 
k 

Chi  Square  Test  and  Significance  Level 

The  test  of  significance  of  variance  between  groups  utilized  In 
this  study  was  the  Chi  Square  Test.    A  small  variance  is  defined  as 
consensus  (reject  for  leage  values  of  Chi  Square).    A  large  variance 
(small  Chi  Square)  Is  defined  as  no  consensus. 

The  significance  level  was  set  at  .995.    The  rejection  level 
utilizing  •995  is  .005  and  the  Chi  Square  values  at  the  appropriate 
<iegrees  of  freedom  was  read  from  Table  8  of  the  Blometrika  Tables  for 
Statisticians. 
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One  or  the  other  of  two  numbers  have  represented  degrees  of  frecdon 
for  analysis  of  the  Organization  of  Adult  Education  Survey*    The  group 
response  calculations  utilized  twelve  decrees  of  freedom  (N  rows*1  k 
N  columns-1).    Twelve  degrees  of  freedom  at  the  #005  level  meant  that 
the  Chi  Square  value  must  have  been  at  or  below  28«2995  to  indicate 
statistically  significant  group  consensus. 

Conclusions 

The  major  conclusions  of  this  study  are  drawn  from  the  research 
conducted  and  the  case  study  of  the  Adult  Education  Association  of 
Michigan. 

I«    An  adult  educator  will  give  his  primery  support  and  dedication 

to  his  specific  area  of  adult  education,  not  to  the  general 

field  of  adult  education. 
2.    An  adult  educator  is  generally  willing  to  support  one 

association  but  will  not  devote  his  time  and  money  to  support 

more  than  one. 

.3«    in  the  opinion  of  the  respondents,  there  is  a  need  for  an 
association  that  speaks  for  the  entire  field  of  adult 
education,  and  enough  common  concerns  among  adult  educators  to 
Justify  its  er.5Stencc. 
4.    in  the  opinion  of  the  respondents,  adequate  services  are  not 
available  to  the  field  of  adult  education.    Providing  these 
services  is  thought  to  be  an  acceptable  role  for  adult 
education  associations. 


n 


5*    Tbe  respondent  adult  educators  believe  that  strong  regional 
differences  exist  in  prograns  of  adult  education  and  that  a 
state-wide  association  should  be  designed  ^:  that  Its  actions 
a;^  determined  by  representatives  of  the  local,  regional,  or 
Institution  programs* 

6.    In  the  opinion  of  the  respondents,  there  is  a  need  for  coordi* 
nated  activity  between  the  various  specific  associations. 
There  is  agreement  that  a  general  type  of  adult  education 
organization  should  be  respcmsible  in  this  area* 

1.    There  is  a  general  lack  of  Icnowledgc  arx)ng  the  respondents, 
outside  of  the  public  adult  education  sector,  as  to  the 
current  status  of  programs  and  problems  in  the  field  of  adult 
education, 

8.    The  respondents  from  the  groups  representing  the  established 
adult  education  associations  (the  Adult  Education  Association 
of  Michigan  and  the  Michigan  Association  for  Public  Adult  and 
Continuing  Education)  feel  that  there  is  competition  for 
members  between  the  current  associations* 

S.    There  exists  a  difference  of  expressed  opinion  in  the  area 
of  the  adequacy  of  the  current  adult  education  associations* 
Those  that  are  now  being  served  generally  feel  there  are  an 
adequate  number  of  associations  for  adult  educators  to  Join* 
Those  that  are  not  now  being  served  express  the  feeling  that 
there  are  not  currently  enough  associations* 


ERiC 
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A  comprehensive  state  a^ult  educ/  *  n  association,  by  its  very 
nature,  must  serve  all  segments  of  the  «.wUlt  eciucatlon  enterprise. 
It  should  be  organized  on  a  strong  regional  or  community  basis.  The 
association  should  concentrate  upon  the  areas  of  communication  and 
service,  primarily  to  a  local  area,  and  secondarily  on  a  state  inter- 
organizational  basis.    The  basic  structure  of  rembership  should  be 
both  Individual  and  organizational.    It  should  be  structured  to  allow 
for  regional  representation  for  direction  of  the  state  level  assoclatli 
It  should  devote  time  and  effort  to  the  pursuit  of  interorg<inlzat{onal 
linkages  of  all  types. 

A  comprehensive  state  adult  education  association  must  try  to 
work  with  a  field  that  is  amorphous  In  nature.    An  association  of  this 
type  must  be  built  upon  common  consensus  and  develop  services  and 
cOfwminlcatlon  that  are  of  mutual  value  to  the  entire  enterprise.  It 
should  not  become  Identified  with  any  one  segment  of  the  field  or 
support  one  against  the  other  when  conflict  occurs. 
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COGNITIVE  STRUCTURE  AND  CONCEPT  FORMATION 
ABSTRACT 

This  study  was  designed  to  determine  the  correlation  coefficient  of 
cognitive  structure  and  concept  formation.    Thirty-four  Ss  assisted  in  the 
study.    Their  tasks  were  to  complete  a  timed  three-dimensional  test  of  concept 
formation  ability  using  Hanfmann's  Block  Test  and  Rokeach's  Dogmatism  Scale* 
It  was  assumed  Hanfmann's  Block  Test  measures  concept  formation  ability  and 
Rokeach's  Dogmatism  Scale  measures  cognitive  structure,    A  correlation 
coefficient  of  .3359  was  generated;  significant  at  ,05  level  of  significance. 
However,  due  to  the  fortituous  nature  of  the  sample  generalization,  results 
may  be  made  only  with  extreme  caution.    Additional  research  is  recommended. 


COGNITIVE  STRUCTURE  AND  CONCEPT  FORliATION 
Huey  3.  Long 

Purpose 

This  study  was  designed  to  determine  the  correlation  coefficient  of 
cognitive  structure  and  concept  formation. 

Significance 

The  significance  of  the  paper  resides  in  the  conceptualization  of  the 
research.    Previous  researchKin  the  area  of  concept  formation  and  cognitive 
structure  generally  have  been  paper  and  pencil  activities.    Furthermore,  the 
idea  of  process  and  structure  being  key  elements  in  concept  formation  appears 
to  be  closely  related  to  the  rationale  of  the  design.    Such  a  conceptualiza- 
tion of  concept  formation  appears    to  have  merit.    If  the  idea  is  supportable, 
it  may  be  possible  to  move  concept  formation  from  the  value-laden  areas  of 
"intelligence^^  and  personality."    Cast  in  such  an  "information  processing" 
framework,  concept  formation  may  be  easier  to  discuss  in  terms  of  remediation. 

Review  of  the  Literature 

Kurt  Lewin  (2)  provided  an  early  theoretical  description  of  the  structure, 
dynamics,  and  development  of  the  person.    According  to  Lewin*s  concept,  the 
individual's  inner-personal  region  is  divided  into  numerous  cells.  Specific 
bits  of  information  may  be  located  in  any  one  of  the  cells  and  communication 
among  or  between  cells  may  be  influenced  by  three  dimensions:    the  nearness- 
remoteness  dimension,  the  firmness-weakness  dimension,  and  the  fluidity-rigidity 
dimension. 


2- 


Rokeach  (10)  has  further  developed  the  concept  of  cognitive  structure 
through  the  theoretical  construct  of  a  belief-disbelief  system*    According  to 
Rokesch's  theory,  cognitive  structure  is  operationally  reflected  In  a  "dogma- 
tism" score.    Dogmatism  is  used  synonymously  with  the  term,  "closed-belief 
system/*    Rokeach  chose  to  study  the  organization  of  the  belief  system  from  a 
"structured*  dimension  rather  than  a  "content"  dimension  because  he  believed 
the  relativ^i  openn^^ss  or  closedness  of  a  mind  cut  across  specific  content* 
He  said  (10,       6),  "The  ax  we  frankly  grind  is  simply  this:    it  is  not  so  much 
what  you  believe  that  counts,  but  how  you  believe*" 

According  to  Rokeach* s  conceptual  framework  the  open-minded  person 
possesses  greater  ability  to  synthesize  information.    In  contrast  the  rigid 
individual  may  have  problems  thinking  analytically  but  not  synthetically* 
Thus,  the  dogmatic  individual  may  astutely  analyze  a  problem  yet  be  unable  to 
integrate  and  synthesize  the  results  of  the  analysis* 

Concept  formation  requires  both  kinds  of  abilities:    the  ability  to 
analyze  and  synthesize*    Smoke  (12)  suggests  that  concept  formation  includes 
the  selection  of  specific  stimuli  out  of  a  complex  stimulating  situation* 
In  addition,  he  indicates  that  grouping  and  insightful  behavior  are  two  other 
significant  factors  in  concept  formation*    Thus,  it  appears  that  concept  forma- 
tion requires  the  ability  to  identify  and  receive  appropriate  information, 
manipulate  the  information  analytically,  and  then  integrate  and  synthesize 
the  information;  abilities  that  may  be  lacking  in  high  dogmatic  individuals* 

Rokeach  and  Vidulich  (11)  made  use  of  the  Doodlebug  Problem  to  investi- 
gate synthetic  thinking  differences  of  open-  and  closed-minded  groups*    In  that 
study  the  mean  times  taken  to  ftolve  the  problem  after  the  first,  second  and 
third  beliefs  had  been  overcome  were  used  as  measures  of  synthesizing  ability* 
The  open-minded  group  required  significantly  less  time  (p  C.Ql)  to  solve  the 
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problem  for  each  variable*    The  time  difference  was  "clearly  due  to  differences 
in  the  ability  to  synthesize,  and  not  in  the  ability  to  analyze/'  according  to 
the  researchers  (11,       213) •    Additional  investigators  have  reported  similar 
results  using  the  Doodlebug  Problem  and  related  exercises  (1,  9)« 

Rokeach  (10)  also  predicted  that  open-  and  closed-minded  subjects  would 
differ  in  synthesizing  perceptual  as  well  as  conceptual  systems*  Accordingly, 
Levy  and  Rokeach  (8)  tested  for  such  differences  using  an  adaptation  of  the 
Kohs  Block  Design  Test.    In  that  test  the  S  Is  presented  a  design  and  asked 
to  reproduce  it  through  the  combination  of  various  painted  blocks  supplied  by 
the  £•    Levy  and  Rokeach  presented  their  Ss  with  six  such  designs  and  lound 
that  in  each  case  the  open-minded  group  was  able  to  complete  the  task  in  less 
time  than  the  closed-minded  group;  however,  none  of  the  differences  were 
significant  at  thr;  .05  level.    A  chi-square  analysis  of  the  Ss  revealed  signi- 
ficant differences  between  open-  and  closed-minded  groups  on  three  of  the  six 
designs.    Contradictory  findings,  however,  have  been  reported  by  Kessler  and 
Kronenberger  (7). 

Simultaneously,  the  literature  appears  to  sup^iort  the  concept  of  p^jcess 
and  structure  as  opposed  to  ''content.  *'    Hunt  (5)  has  suggested  that  problem- 
solving  capacity  is  dependent  upon  stratef>ies  for  information  processing. 
Bingham,  cited  by  Hunt,  indicates  insight  occurs  through  the  combinl^^g  ^-^nd 
recombining  of  central  processes  derived  from  past  experience  in  which  organized 
patterns  of  behavior  are  combined  and  recombined  as  new  situations  might  demand. 
The  impcrtance  of  process  is  suggested  by  Newell,  Shaw  and  Simon,  cited  by 
Hunt  (5).    They  indicate  that  the  individual  possesses  a  Stories  of  process^*s 
for  receiving  and  acting  on  information  that  operate  by  a  definite  set  of  rules. 

Various  writers  in  the  area  of  cognition  have  supported  the  premise  that 
concept  formation,  thinking  and  problem-solving  involve  che  two  processes  of 
differentiation  of  analysis  and  integration  (4,  6,  13).    Such  a  view  appears 
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to  provide  support  for  the  suggestion  that  concept  formation  is  influenced  by 
the  process  used  to  analyze  and  integrate  information.    If  process  and  structure 
are  the  key  factors  in  concept  formation,  it  can  be  understood  how  apparent 
"highly  knowledgeable'*  individuals  can  be  dogmatic  and/or  circular  in  their 
thinking. 

Research  Methodology 
Conceptual  Framework 

Based  on  the  literature  reviewed,  it  appears  that  concept  formation  may 
be  **•  con  tent-"' free.    It  is  further  postulated  that  concept  formation  may  be 
media-  or  form-free,  i.e.,  not  r^istricted  to  oral,  written,  structural,  visual 
or  tactile  information.    Concept  formation  is  viewed  as  an  ability  to  identify, 
select,  and  receive  appropriate  information,  to  manipulate  the  information 
analytically  and  finally  to  integrate  and  synthesize  the  results  of  the  analysis. 
Such  a  process  is  theoretically  based  on  cognitive  structure  rather  than 
cognitive  content.    Accordingly,  the  following  research  project  was  designed  to 
test  a  specific  related  sypothesis. 
Basic  Assumptions 

Basic  assumptions  important  in  developing  the  research  methodology  were 
as  listed  below. 

1.  Rokeach's  Dogmatism  Scale  measures  cognitive  structure. 

2.  Hanfmann's  Block  Test  measures  concept  formation  ability. 
Definition  of  Terms 

Operational  definitions  of  key  terms  used  in  the  studies  are  as  follows: 

1.  University  students  are  individuals  registered  for,  and  participating 
in,  regular  classes  at  the  University  of  Georgia. 

2.  Cognitive  structure  is  defined  in  terms  of  the  Ss  scores  on  Rokeach's 
Dogmatism  Scale* 
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3*    Hanfmann's  Block  Test  (3)  Is  a  n.odif ication  of  a  procedure  used  by 
Eugenia  Hanfmann  and  Jacob  Kasanin  to  measure  concept  formation.  The 
procedure  is  described  in  detail  later  (henceforth  referred  to  as  HBT) . 

4.    Concept  formation  is  operationally  defined  according  to  length  of  time 
required  by  Ss  to  develop  a  conceptually  sound  classification  system 
for  the  blocks  in  the  HBT, 

Hypothesis 

Stated  in  the  null  foirm,  the  hypothesis  tested  at  the  .05  level  of  signi- 
ficance is  as  follows:    there  is  no  significant  relatio    hip  between  concept 
formation  and  cogni  Lve  structure  scores  among  Ss  in  this  study. 
Population  and  Sample 

Thirty-four  Ss  were  included  in  the  study.    The  sample  was  a  fortuitous 
one  :;ince  all  the  Ss  were  university  students  who  agreed  to  assist  with  the 
research. 

Data  Collection  Procedures 

The  procedures  followed  in  the  study  are  outlined  below: 

Request  of  students  to  participate  in  the  study.    The  purpose  and  details 

of  the  study  were  not  described  or  explained  imtil  the  project  was  completed. 
Administration  of  Rokeach's  Dogmatism  Scale. 
Individual  appointments  of  students  with  a  graduate  assistant. 
Administration  of  HBT  individually  by  graduate  assistant. 
Computation  of  results. 

Description  of  Instruments 

Rokeach's  Dogmatism  Scale  is  widely  known.    Thus,  the  reader  is  referred 
to  the  Open  and  Closed  Mnd  for  details.    Form  E  consisting  of  40  items  was 
used.    Each  S  was  given  the  instrument  under  the  title  ^'Opinion  Survey*'  to 
complete  between  class  sessions. 
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HBT  consists  of  20  blocks  of  wood  in  5  geometric  shapes,  and  4  colors. 
There  are  10  thick  blocks  and  10  thin  ones.    Each  geometric  shape  is  represented 
by  4  blocks  of  differing  sizes.    For  example,  there  are  4  circles  of  different 
dimensions.    The  Ss'  task  is  to  develop  a  conceptual  classification  system 
that  will  logically  divide  the  blocks  among  4  subsystems;  each  subsystem 
containing  5  blocks.    The  S  may  make  as  many  attempts  as  he  wishes.    Iflieh  he 
believes  he  has  the  correct  classification,  he  notifies  the  E.    He  then  explains 
the  system.     If  the  S  is  incorrect,  he  may  make  additional  attempts. 

After  the  E  has  checked  the  arrangement  two  times  and  the  system  remains 
incorrect,  the  S  may  turn  two  blocks  over  to  secure  two  bits  of  information. 
On  the  underside  of  each  block  is  a  nonsense  syllable  such  as  BLK,  LAG,  MOR, 
or  CEN.    The  nonsense  syllables  are  keys  to  the  4  subsystems. 

In  this  study  Ss  were  allowed  up  to  60  minutes  to  complete  the  task. 

Findings 

Dogmatism  scores  ranged  from  86  to  197.    Concept  formation  tasks  required 
from  3  minutes  to  53  minutes.    The  mean  dogmatism  score  was  129.08.    The  mean 
conce;  <  juormation  task  time  was  ?1.65. 

The  null  hypothesis  that  there  is  no  significant  relationship  between 
concept  formation  and  cognitive  structure  scores  among  Ss  in  this  study  was 
rejected.    A  correlation  coefficient  of  .3359  was  generated.    The  coefficient 
is  significant  at  the  .05  level. 

Conclusions 

Based  on  the  data  generated  by  this  study,  it  appears  that  there  is  a 
relationship  between  cognitive  structure  and  concept  formation  for  selected 
groups.    Because  of  the  nature  of  the  sample  used  in  the  study,  generalization 
of  the  finding  may  be  made  only  with  extreme  caution  and  tentativeness.  Yet, 
the  results  are  sufficiently  encouraging  to  suggest  additional  research. 
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AN  EVALUATION  OF  THE  EXPANDED  FOOD  AND  NUTRITION 
EDUCATION  PROGRAM  IN  MISSOURI 
by 

Nelda  Nolan  and  John  Gross 
University  of  Missouri 

Introduction 

During  the  1960 *s  the  Congress  of  the  United  States  discovered  that 
in  this  land  of  plenty  there  are  people  who  are  malnourished.    A  report 
by  the  Citizens'  Board  of  Inquiry  into  Hunger  and  Malnutrition  estimated 
that  there^are  fourteen  million  hungry  people  in  this  country.^  These 
people  live  in  every  state.    No  state  is  free  of  hunger  anymore  than  any 

state  is  free  of  poverty  or  deprivation. 

2 

A  nationwide  survey  in  1965    was  concerned  with  the  food  consumption 
of  families  in  the  United  States.    The  results  of  this  survey  showed  that 

only  50%  of  the  households  had  diets  that  were  rated  good.    About  20%  of 
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the  households  had  diets  that  were  rated  poor.      A  somewhat  larger  number 
were  rated  poor  in  1965  than  in  1955  when  the  previous  nationwide  survey 
was  made.    Nearly  40%  of  the  households  with  incomes  under  $3,000  had 
poor  diets.    The  percentage  of  households  with  good  diets  increased  markedly 
with  income. 

Regardless  of  the  extent  to  which  malnutrition  exists  it  is  a  very 
serious  problem  for  the  individual  who  is  hungry  and  for  the  society  which 
allows  him  to  go  hungry.    The  societal  implications  of  malnutrition  ip 
this  country  are  particularly  ugly.    As  former  Senator  Clark  has  pointed 
out,  the  mind  tends  to  reject  the  evidence  that  children  can  and  do  starve 
in  the  most  abundant  and  fruitful  of  all  nations.      Since  it  is  usually 
difficult  to  mobilize  the  entire  nation  for  the  solution  of  a  problem, 
especially  if  the  situation  is  as  hidden  as  malnutrition  tends  to  be,  one 
approach  is  to  deal  directly  with  those  most  effected  by  the  problem. 
^  This  approach  has  been  characteristic  of  the  efforts  to  deal  with  malnutrition. 
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The  Expanded  Food  and  Nutrition  Education  Program  was  Introduced  In 
the  fifty  states,  Washington,  D.  C,  the  Virgin  Islands,  and  Puerto  Rico 
In  1968.    The  program  was  administered  on  the  local  level  by  the  Coopera- 
tive Extension  Service  under  the  sponsorship  of  the  United  States  Depart- 
ment of  Agriculture.    The  primary  objective  of  the  Expanded  Food  and  Nu- 
trition Education  Program  was  to  assist  low  Income  families  with  children 
to  Improve  the  nutritional  adequacy  of  their  diet.    This  was  supplemented 
by  several  more  specific  objectives: 

1.  To  Increase  knowledge  of  the  relationship  of  nutrition 
to  health  and  well-being; 

2.  To  Increase  food  buying  skills  to  Insure  maximum  value 
from  the  dollars  Invested  In  food; 

3.  To  "develop  food  preparation  skills  In  order  to  serve 
palpable  meals  and  Insure  ma:clmum  preservation  of  food 
nutrients  with  minimum  waste; 

4.  To  develop  skills  In  the  care  and  storage  of  the  family 
food  supply; 

5.  To  encourage  eligible  families  to  participate  In  the 
Food  Stamp  or  Commodity  Food  Program; 

6.  To  Increase  the  ability  of  the  family  to  manage  the 
family  resources  Including  food  stamps  or  commodity 
foods. 

A  key  feature  of  the  program  Is  the  use  of  the  paraprof esslonal  Nu- 

it 

trltlon  Education  Assistant.    She  Is  a  woman   who  has  a  social  and  econ- 
omic background  similar  to  that  of  the  women  with  whom  she  works.  She 
teaches  low  Income  homemakers,  either  Individually  or  In  small  groups, 
showing  them  ways  to  Improve  the  nutritional  adequacy  of  their  diets. 
Upon  being  hired,  the  Nutrition  Education  Assistants  are  given  several 
weeks  of  Intensive  orientation  training.    This  Is  followed  by  regular  In- 
service  training.    In  general,  their  knowledge  of  nutrition  before  employ- 
ment is  no  greater  than  that  of  the  persons  with  whom  they  will  be  working. 


*  All  Nutrition  Education  Assistants  in  Missouri  have  been  women.  Some 
other  states  have  employed  male  Assistants. 
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The  Expanded  Food  and  Nutrition  Education  Program  was  started  In 
Missouri  In  January,  1969.    It  began  In  five  Extension  program  planning 
locations  In  the  state  —  St.  Louis,  Kansas  City,  and  the  Mld-Mlssourl, 
Bootheel,  and  Ozark  Foothills  Areas.    There  were.  Initially,  90  Nutrition 
Education  Assistants.    By  the  close  of  1969,  the  program  had  been  expanded 
In  the  two  metropolitan  areas  and  In  the  Bootheel  and  had  been  Initiated 
In  the  Lakes  Country  Area.    The  total  number  of  Nutrition  Education  As- 
sistants had  risen  to  150.    The  program  was  extended  to  six  additional  lo- 
cations In  1970.    These  were:    ABCD,  Kayslnger  Basin,  Mark  Twain,  Ozark 
Gateway,  Show-Me,  and  South  Central  Ozarks  Areas.  ^fiBBO^Ma^u^^^^^^^ 


As  of  March  30,  1972,  the  month  In  which  this  evaluation  data  was  collected, 
there  were  186  Nutrition  Education  Assistants  In  twelve  units  In  Missouri. 
These  Assistants  had  enrolled  9,607  program  families.    There  were  50,711 
persons  In  these  families.  Including  33,722  children. 

The  Need  for  Evaluation 

During  the  last  decade,  an  abundance  of  socially  oriented  programs 
have  been  developed.    Each  of  these  programs  was  aimed  at  dealing  with 
some  social  problem  and  producing  good  for  some  neglected  segment  of  society. 
As  more  and  more  of  these  programs  come  Into  being  and  compete  for  public 
support  and  money,  the  public  demands  that  they  produce  evidence  of  the 
good  that  they  are  doing.    Evaluative  research  has  become  a  major  weapon 
In  this  contest  for  public  support. 

The  Expanded'  Food  and  Nutrition  Education  Program  Is  one  program  that 
has  felt  the  need  to  provide  evidence  of  the  accompllsViments  It  has  made. 
Evaluation  was  built  Into  the  Expanded  Food  and  Nutrition  Education  Pro- 
gram from  the  very  beginning.    Data  have  been  collected  from  the  Initiation 
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of  the  program  concerning  its  efforts  to  achieve  its  goals.    At  the  time 
of  this  study,  monthly  reports  were  made  to  the  Extension  Service,  USDA, 
concerning  the  number  of  families  enrolled  in  the  program,  the  number 
visited  on  a  monthly  basis,  the  number  of  youth  and  volunteers  worked  with, 
and  the  number  of  Assistants  doing  the  work.    Every  six  months,  data  were 
collected  regarding  socio-economic  characteristics  of  the  families  en- 
rolled in  the  program,  their  food  consumption  habits,  and  their  knowledge 
of  basic  nutrition.    By  examining  these  data  across  time,  it  is  possible  to 
see  changes  in  the  outreach  of  the  program,  changes  in  the  characteristics 
of  the  families  worked  with,  changes  in  their  knowledge  of  nutrition,  and, 
most  Importantly,  changes  in  their  diets. 

The  data  used  to  determine  dietary  adequacy  were  gathered  by  personal 
interview,  obtaining  a  24  hour  food  recall  from  each  program  homemaker 
once  every  six  months.    The  Nutrition  Education  Assistant  working  with  a 
given  homemaker  collected  these  data.    Assistants  were  specially  trained 
to  obtain  data. 

The  adequacy  of  a  homemaker *s  diet  was  assessed  in  terms  of  the  num- 
ber of  the  recommended  daily  servings  of  each  of  the  four  food  groups  that 
she  consumed.    An  adequate  daily  diet  should  consist  of  two  servings  of 
meat,  two  servings  of  milk,  four  servings  of  fruits  and  vegetables,  and 
four  servings  of  breads  and  cereals.    No  attempt  was  made  to  assess  the 
adequacy  of  the  diet  in  terms  of  the  nutrients  it  contained. 

The  data  on  the  homemaker 's  knowledge  of  basic  nutrition  were  also 
gathered  every  six  months  by  the  Nutrition  Education  Assistants.  Each 
homemaker  was  asked  to  name  the  foods  she  thought  a  person  needed  every 
day  in  order  to  be  healthy.    The  foods  named  were  classified  according  to 


the  four  basic  food  groups*    A  homemaker  was  said  to  have  greater  or  less 
knowledge  of  basic  nutrition,  depending  upon  how  many  of  the  four  basic 
food  groups  were  represented  by  the  foods  she  named. 

The  data  indicate  that,  in  terms  of  effort,  the  Expanded  Food  and 
Nutrition  Education  Program  has  been  successful.    As  of  March  31,  1972, 
the  month  in  which  our  evaluation  study  was  conducted,  the  average  full- 
time  equivalent  (FTE)  Nutrition  Education  Assistant  in  Missouri  had  en- 
rolled 49.5  program  families.    During  that  month  she  visited  an  average 
of  36  of  these  families  at  least  once.    In  addition,  she  visited  with  an 
average  of  26  nonprogram  families  and  34  youth.    She  was  assisted  in  her 
effort  by  a  volunteer.    Thus,  in  the  course  of  the  month  she  taught  nu- 
trition to  almost  100  persons. 

The  data  indicated  that  families  participating  in  the  Expanded  Food 
and  Nutrition  Education  Program  improved  their  diets.    When  the  diets  of 
homemakers  who  had  been  in  the  program  for  varying  lengths  of  time  were 
compared,  it  was  clear  that  those  who  had  been  enrolled  at  least  six 
months  had  better  diets  than  those  newly  enrolled.    In  the  March,  1972, 
recall,  50%  of  the  newly  enrolled  homemakers  reported  at  least  one  serving 
from  each  of  the  four  food  groups  compared  to  59%  for  homemakers  who  had 
been  enrolled  for  a  longer  time.    This  increased  adequacy  of  consumption 
was  apparent,  for  all  four  of  the  basic  four  food  groups  continued  to  im- 
prove for  approximately  eighteen  to  twenty-four  months. 

The  data  about  knowledge  of  basic  nutrition  indicated  that  program 
homemakers  increased  their  knowledge.    Only  57%  of  the  homemakers  named 
foods  from  each  of  the  basic  four  food  groups  as  being  necessary  for  health 
when  first  enrolled  in  the  Expanded  Food  and  Nutrition  Education  Program. 
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After  three  years  of  participation,  over  80%  could  do  this. 

These  data  suggest  that  the  Expanded  Food  and  Nutrition  Education 
Program  has  been  successful  in  its  efforts.    But,  the  data  leave  an  im- 
portant question  unanswered:    Can  the  increase  in  adequacy  of  diets  which 
is  observed  among  program  families  be  attributed  to  the  program? 

Objectives  of  the  Study 

There  were  two  primary  objectives  of  this  study.    First,  to  determine 
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whether  there  were  differences  in  the  behavior  of  program  and  control 
families  with  regard  to  the  program  objectives.    If  there  were  behavior 
differences,  it  would  be  assumed  that  the  Expanded  Food  and  Nutrition  Edu- 
cation Program  was  the  causal  factor.    The  second  objective  was  to  deter- 
mine if  there  were  any  characteristics  which  distinguished  those  program 
families  whose  diets  were  adequate  from  those  program  families  whose  diets 
were  inadequate.    This  would  provide  the  needed  information  about  the 
factors  which  influence  food  consumption. 

With  regard  to  the  first  objective,  three  hypotheses  were  developed. 
Each  focused  on  a  different  program  objective.    It  was  hypothesized: 

1.  Families  who  were  participating  in  the  Expanded  Food 
and  Nutrition  Education  Program  would  have  diets  that 
were  more  adequate  in  terms  of  the  Recommended  Daily 
Dietary  Allowance  of  selected  nutrients  than  families 
who  were  not  participating; 

2.  families  who  were  participating  in  the  Expanded  Food 
and  Nutrition  Education  Program  would  have  higher 
scores  on  a  measure  of  food  buying  skills  than  families 
who  were  not  participating;  and 

3*    families  who  were  participating  in  the  Expanded  Food 
and  Nutrition  Education  Program  would  have  higher 
scores  on  a  measure  of  nutrition  knowledge  than  fa- 
milies who  were  not  participating. 


*  A  description  of  the  control  families  is  included  in  this  report  on  page 


With  regard  to  the  second  objective,  it  was  hypothesized  that  an  ade- 
quate diet  for  program  families  would  relate  positively  with  certain  char- 
acteristics of  the  family.    The  expected  influential  characteristics  were: 

1.  race; 

2.  homemaker*s  age; 

3.  homemaker's  education; 

4.  family  income; 

5.  mass  media  awareness; 

6.  participation  in  food  assistance  programs;  and 

7.  participation  in  Jaml  niiiiin  i  ■nwiBiIlij^  P^^khc^    ^ee^/iy  j  / «^ ^^'Htf  , 

It  was  also  hypothesized  that  adequacy  of  family  food  consumption  would 
be  positively  related  to  two  characteristics  of  the  program,  the  frequency 
of  visits  with  the  Nutrition  Education  Assistant  and  tenure  in  the  program. 

Design  of  the  Study 

The  State  of  Missouri  contains  both  highly  urbanized  areas  and  very 
rural  areas.    The  twelve  units  of  the  Expanded  Food  and  Nutrition  Educa- 
tion Program  In  Missouri  are  located  in  areas  that  range  along  the  total 
continuum  from  urban  to  rural.    Differences  between  the  program  in  urban 
areas  and  in  rural  areas  have  been  observed.    These  dif fii^i^ences  are  believed 
to  be  a  function  of  the  urban- rural  nature  of  a  particular  area.  These 
differences  include  such  things  as  the  number  of  times  that  an  Assistant 
visits  with  a  homemaker,  the  likelihood  that  a  homemaker  will  be  visited 
in  her  home  as  opposed  to  being  visited  in  a  group,  the  possibility  of 
growing  a  home  garden,  the  use  of  food  stamps  as  opposed  to  the  use  of 
commodity  foods,  the  availability  of  public  programs  providing  foods,  the 
availability  of  public  services,  and  the  percentage  of  program  children 
who  are  enrolled  in  4-H  type  Expanded  Food  and  Nutrition  Education  Program 
activities. 
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There  arey  of  course,  other  differences  between  an  urban  and  a  rural 
area  which  may  have  at  least  indirect  influence  upon  a  homemaker's  accep- 
tance of  the  program.    Because  of  these  differences,  it  was  felt  that  the 
urban-rural  nature  of  an  area  was  an  important  factor  to  be  considered  in 
program  evaluation.    Thus,  the  three  areas  that  were  chosen  for  the  evalu- 
ation study  were  representative  of  varying  points  along  an  urban  to  rural 
continuum.    These  ^'reas  were:    St.  Louis  City,  representing  an  urban  area, 
Macon  County,  representing  a  small  town  area,  and  Carter  and  Ripley  Counties, 
which  represent  a  rural  area. 

For  every  program  area  used  in  this  study,  another  area  that  was  adja- 
cent and  similar  to  it  ^as  chosen  for  use  as  a  control  area.    Fov  the  City 
of  St.  Louis  it  was  possible  to  have  the  control  area  within  tae  city  since 
the  Expanded  Food  and  Nutrition  Education  Program  did  not  cover  the  entire 
city*    For  Macon  County  the  control  county  was  Linn.    Linn  County  is  also 
a  small  town  county,  adjacent  to  the  west  side  of  Macon  County.    For  Carter 
and  Ripley  Counties  the  control  counties  were  Shannon  and  Oregon,  which  are 
very  rural  areas  adjacent  to  the  west  side  of  the  program  counties.  The 
use  of  control  areas  was  deemed  vital  to  provide  a  complete  answer  to  the 
question  of  whether  any  increase  in  the  adequacy  of  diets  among  program 
families  could  be  attributed  to  the  Expanded  Food  and  Nutrition  Education 
Program. 

The  design  of  the  study  is  what  Campbell  and  others^  have  called  a 
static  group  comparison.  The  entire  study  was  done  after  the  treatment 
had  been  administered  to  the  program  group. 

At  the  time  of  this  study,  work  in  two  of  the  areas,  St.  Louis  City 
and  Carter  and  Ripley  Counties,  had  been  in  operation  for  three  years. 


ERIC 


Thus,  it  was  possible  to  introduce  another  variable:^  The  sample  of  pro- 
gram families  chosen  for  interviewing  in  these  two  areas  were  selected  to 
represent  families  who  had  been  in  the  program  for  varying  lengths  of 
time.    In  the  third  program  area,  Macon  County,  this  was  not  possible  be-- 
cause  the  program  had  been  in  operation  there  for  only  one  year. 

It  was  decided  that  a  sample  of  200  program  families  and  200  control 
families  would  be  appropriate  for  this  study.    One  hundred  of  the  program 
families  and  100  of  the  control  families  were  to  be  selected  from  St.  Louis 
City.    Fifty  program  families  and  fifty  control  families  were  to  be  selected 
from  each  of  the  other  two  areas.    The  Manual  for  Nutrition  Sutveys,  by 
the  National  Institute  of  Health,  reported  that,  "Experience  indicates 
that  a  minimum  of  15  families  is  required  to  give  satisfactory  data  by 
means  of  the  24-hour  recall  questionnaire  method  within  a  population  sam- 
pie  of  approximately  1500  people."    At  the  time  of  this  study,  there  were 
1927  program  families  in  St.  Louis,  106  in  Macon  County,  and  277  in  Carter 
and  Ripley  Counties.    Thus,  the  chosen  sample  size  should  give  satisfactory 
results. 

In  Macon  County,  where  the  program  had  been  in  operation  for  only  one 
year,  the  fifty  program  families  were  chosen  at  random  from  a  total  list 
of  enrolled  program  families.    In  St.  Louis  City  and  Carter  and  Ripley 
Counties,  where  the  program  had  been  in  operation  for  three  years,  the 
total  list  of  program  families  was  divided  into  four  parts:    those  families 
who  had  been  in  the  program  less  than  seven  months;  those  who  had  been  in 
the  program  seven  to  twelve  months;  thoae  who  had  been  in  the  program 
thirteen  to  eighteen  months;  and  those  who  had  been  in  over  eighteen  months. 
No  program  families  were  selected  for  interviewing  who  had  been  in  the 
program  less  than  seven  months.    An  equal  number  of  program  families  were 


10 

then  randomly  selected  for  interviewing  within  each  of  the  other  three 
time  intervals*    The  random  nature  of  the  selections  was  insured  by  use  of 
a  table  of  random  numbers* 

Throughout  the  course  of  this  study,  <issistance  sras  provided  by  the 
Field  Research  Team  of  the  Department  of  Agricultural  Economics  and  Rural 
Sociology*    It  was  this  team  that  drciw  the  control  sample  for  use  in  this 
study*    Cooperation  was  obtained  from  the  Division  of  Welfare.    They  pro- 
vided the  names  of  families  in  the  control  areas  recei^jing  public  assis-- 
tance  and/or  federally  sponsored  food  assistance*    The  control  farllies 
for  this  study  were  drawn  from  this  list  of  persons  and  their  neighbors* 
They  were  selected  to  be  as  nearly  like  the  program  families  as  possible 
with  regard  to  certain  cftaracteristics:    place  of  residence,  receipt  of 
welfare,  number  of  children  under  nineteen  years  of  age,  age  of  homemaker, 
participation  in  a  food  assistance  program,  education  of  the  homemaker, 
and  household  income* 

Each  of  the  potential  control  families  was  visited  by  a  member  of  the 
Field  Research  Team  before  interviewing  to  determine  their  eligibility  to 
be  interviewed*    If  a  family  was  not  eligible  because  they  did  not  match 
with  one  of  the  program  families,  they  were  asked  to  supply  the  names  of 
three  additional  families  who  were  of  circumstances  similar  to  theirs* 
In  this  way  it  was  possible  to  include  in  the  control  sample  persons  who 
were  not  receiving  welfare  and/or  participating  in  one  of  the  food  assii.- 
tance  programs* 


The  Data 

All  data  were  collected       interview*    The  interview  schedule  was  de- 
veloped by  the  members  of  the  Expanded  Food  and  Nutrition  Education  Program 


(EFNEP)  Committee.  Suggestions  concerning  the  schedule  were  obtained  from 
the  EFNEP  Advisory  Committee,  Dr.  Norge  Jerome  of  the  University  of  Kansas 
Medical  Center,  and  other  qualified  persons. 

The  schedule  went  through  a  series  of  revisions.    The  final  revision 
was  preceded  by  a  pre-test.    The  pre-test  consisted  of  administering  the 
schedule  to  13  program  homemakers  in  the  St.  Louis  area.    The  13  homemakers 
used  in  the  pre-test  were  eliminated  from  participating  in  the  final  col- 
lection of  data.    Only  two  months  elapsed  between  the  pre-test  and  the 
final  collection  of  data,  so  the  influence  should  have  been  minimal,  if 
any.    The  pre-testing  was  done  by  four  members  of  the  FFNEP  Committee.  On 
the  basis  of  the  pre-test,  final  revisions  were  made  and  the  schedule  was 
developed  into  its  final  form. 

Details  about  the  schedule  ?re  presented  elsewhere  in  this  report. 

Collection  of  the  Data 

It  was  deemed  important  that  persons  who  collected  the  data  for  the 
evaluation  study  should  possess  two  characteristics:    a  knowledge  of  the 
subject  matter  of  foods  and  nutrition  and  an  ability  to  communicate  effec- 
tively with  the  persons  to  be  interviewed.    After  discussing  these  quali- 
fications with  Dr.  Norge  Jerome  and  with  the  Expanded  Food  and  Nutrition 
Education  Program  Advisory  Committee,  it  was  decided  that  the  Nutrition 
Education  Assistants  filled  both  of  these  qualifications.    Most  important, 
they  were  well  qualified  to  communicate  with  the  persons  to  be  interviewed. 
Thus,  it  was  decided  that  the  Assistants  would  do  the  interviewing  for  the 
evaluation  study.    However,  it  was  felt  that  it  would  be  unwise  to  have  an 
Assistant  interview  the  program  families  with  whom  she  had  been  working. 
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since  some  of  the  data  could  be  construed  as  reflecting  either  favorably 
or  unfavorably  upon  the  Assistant  and  since  the  program  homemakers  might 
feel  that  they  were  being  tested  if  their  usual  Assistant  did  the  inter- 
viewing • 

The  Assistants  received  three  days  of  intensive  training  in  inter- 
viewing procedures  and  in  understanding  the  interview  schedule.  This 
training  was  conducted  by  the  Supervisor  of  the  Field  Research  Team  from 
the  Depaicment  of  Agricultural  Economics  and  Rural  Sociology.    The  train- 
ing involved  reviewing  each  question  on  the  interview  schedule.  '^^Tipleting 
a  practice  schedule  with  a  friend,  and  role  playing,  which  included  knock- 
ing, introducing  oneself,  and  dealing  with  some  difficult  problems  that 
might  be  encountered  in  the  process  of  data  gathering.    At  the  end  of  the 
three  days  of  training.  Assistants  still  having  problems  with  the  inter- 
viewing procedures  were  asked  not  to  participate  in  the  interviewing. 

Because  it  took  three  days  to  gather  all  the  information  from  one 
family,  interviews  were  begun  on  Monday,  Tuesday,  or  Wednesday.    This  al- 
lowed interviews  to  be  completed  by  Wednesday,  Thursday,  or  Friday.  Week- 
ends were  avoided  in  gathering  the  data  because  it  was  felt  that  families 
frequently  eat  differently  on  weekends  than  they  do  during  the  week.^  An 
attempt  was  also  made  to  avoid  interviewing  the  day  and  shortly  after  wel- 
fare checks  were  distributed  because  this  could  bias  diets  of  people. 

All  data  were  obtained  from  the  ptogram  homemaker.  ^  The  initial  in- 
terview took  approximately  an  hour  to  an  hour  and  a  half.    The  Assistant 
obtained  the  demographic  nutrition  knowledge,  food  buying  skills,  and  food 

*  For  the  purposes  of  this  program,  the  homemaker  is  defined  as  the  person 
in  a  given  household  who  has  primary  responsibility  for  food  preparation. 
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frequency  data  and  asked  the  homemaker  to  recall  what  and  how  much  her  family 
had  eaten  at  home  in  the  24  hours  immediately  preceeding  the  interview.  On 
the  second  and  third  days  of  the  interview,  additional  family  food  consump- 
tion records  were  obtained*    This  procedure  was  explained  in  more  detail 
elsewhere  in  this  report. 

All  data  were  gathered  in  March,  1972,  within  a  one-week  period  in 
the  Macon-Linn  and  Carter-Ripley-Shannon-Oregon  areas  and  within  two  weeks 
in  St.  Louis.    At  the  end  of  each  day  of  interviewing  the  Program  Assis- 
tant's completed  interview  schedules  were  reviewed  and  edited  by  the 
Supervisor  of  Field  Research.    Any  data  that  were  missing  were  to  be  gath- 
ered by  the  Assistant  on  her  return  visit  to  the  family.    Any  inadequacies 
in  gathering  the  food  consumption  data  were  explained  to  the  Assistant  so 
that  she  could  improve  her  techniques • 


Food  Intake  Data 

There  are  a  variety  of  ways  in  which  to  evaluate  the  nutritional 
status  of  an  individual*    These  methods  include  clinical  observations, 
biochemical  analysis,  and  anthropometric  measurements.    However,  for  the 
purposes  of  this  study,  there  was  no  attempt  to  evaluate  the  nutritional 
status  of  individual  persons.    The  attempt  was  to  assess  differences  in 
the  nutritive  intake  of  program  families  and  nonprogram  famiL.ies.  The 
assessment  of  the  nutrient  intake  of  each  of  these  groups  would  allow  con- 
clusions to  be  drawn  comparing  the  adequacy  of  each  group's  nutrient  in- 
take on  the  specific  days  covered  by  the  study.    However,  it  would  not 
provide  direct  evidence  of  whether  a  given  person  was  well  or  poorly 
nourished. 


ERLC 


*  Assistance  in  writing  this  section  of  this  report  was  provided  by  Mildred 
Bradsher,  Associate  Professor  of  Foods  and  Nutrition,  State  Foods  and 
Nutrition  Specialist,  University  of  Missouri. 
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There  are  also  several  methods  for  assessing  nutrient  intake.  One 
method  is  to  inventory  all  the  foods  available  at  the  beginning  of  the 
study  and  all  foods  obtained  during  the  course  of  the  study.    Food  re- 
maining in  the  inventory  at  the  end  of  the  study  and  food  that  was  wasted 
during  the  course  of  the  study  are  subtracted  from  the  first  two  amounts  • 
to  get  an  approximation  of  the  food  eaten  by  the  group  during  the  course 
of  the  study. 

Obtaining  twenty-four  hour  recall  data  is  another  method,  which  in- 
volves an  /nterview.    A  trained  person  asks  the  subject  to  recall  the 
kinds  and  amounts  of  foods  consumed  in  the  previous  twenty-four  hours, 

A  third  method  is  to  obtain  the  dietary  history.    The  subject  is  in- 
terviewed and  asked  questions  about  his  past  dietary  habits,  his  food  likes 
and  dislikes,  food  allergies,  and  seasonal  variations  in  intake.    Food  in- 
take or  dietary  records  are  obtained  by  having  a  person  write  down  all 
foods  and  amounts  consumed  for  a  one-day  multiple-day  length  of  time. 
Weight  of  food  consumed  is  obtained  by  having  the  subject  weigh  all  food 
that  is  on  his  plate  before  eating  and  then  weigh  all  food  that  is  left  on 
the  plate  after  he  has  finished. 

Each  of  these  methods  of  evaluating  dietary  intake  has  its  strengths 
and  weaknesses.    Some  of  them  are  very  time  consuming  and  some  are  less 
so.    Some  of  them  require  a  great  deal  of  cooperation  on  the  part  of  the 
subject  while  others  require  little.    Some  of  them  are  of  a  nature  that 
allows  the  subject  to  modify  his  intake  practices  as  a  result  of  the  study 
while  others  avoid  this  but  rely  upon  memory.    Thus  it  appears  that  Beal 
was  right  when  she  concluded,  "It  is  obvious  then  that  no  method  of  ob- 
taining information  about  the  diets  of  individuals  is  without  flaw.  But 
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if  we  are  to  evaluate  the  nutritional  status  of  people,  we  must  develop 

skills  and  techniques  to  obtain  the  best  possible  data  and  keep  in  mind 

the  limitations  of  whatever  method  is  used."^ 

Young  and  her  associates  have  written,  "Evidence  presented  in  this 

study  gives  further  support  to  previous  conclusions  that  for  studies  of 

the  average  dietary  intake  of  a  group  the  simplest  possible  techniques 
o 

seemed  justified/' 

With  this  in  mind  and  after  consultation  with  Dr.  Norge  Jerome  and 
the  Foods  and  Nutrition  Specialists  on  the  Expanded  Food  and  Nutrition 
Education  Program  Committee,  a  procedure  which  involved  obtaining  a  rec- 
ord of  each  family's  food  consumption  for  72  hours  was  developed.  The 
kind  and  amounts  of  food  that  were  prepared  and  consumed  by  the  family 
members  at  home  during  the  24  hours  preceding  the  initial  interview  were 
recorded  as  recalled.    To  assist  the  homemaker  in  estimating  the  amounts 
of  foods  prepared  and  eaten  at  home,  the  interviewers  gave  each  homemaker 
a  one  cup  dry  measure  and  a  set  of  four  measuring  spoons.    These  were  to 
be  a  gift  from  the  interviewer  to  the  homemaker  and  were  to  be  used  by  her 
in  estimating  the  amount  of  food  prepared  and  eaten.    It  was  also  felt  that 
the  small  gift  might  be  sufficient  to  induce  the  continued  participation 
that  was  needed  over  a  three-day  period. 

To  minimize  the  problems  associated  with  recalling  the  food  prepared, 
the  interviewers  asked  each  homemaker  to  write  down  on  a  form  which  was 
left  with  her  all  the  food  that  she  or  anyone  else  prepared  for  her  family 
to  eat  at  home  during  the  next  24  hours,  and  who  ate  the  food  and  how  much 
was  left  over.    Prepared. foods  that  were  bought  outside  the  home  were  not 
included.    If  guests  were  present  for  a  meal  or  snack,  their  age  and  sex 
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were  recorded* 

On  the  second  day  the  interviewer  returned  to  the  family's  home,  re- 
viewed what  the  homemaker  had  written  and  r  stained  more  detailed  informa- 
tion as  it  was  needed.    At  that  time,  she  left  another  form  and  asked  the 
homemaker  to  continue  for  another  24  hours.    On  the  third  day,  she  returned 
and  again  reviewed  what  the  homemaker  had  written  and  to  be 'sure  it  was  as 
accurate  as  possible.    After  the  third  24  hours  of  food  consumption  had 
been  recorded,  the  interview  of  a  family  was  completed. 

A  procedure  similar  to  this  was  employed  by  Patterson  in  exploring 
the  food  habits  and  physical  development  of  fourth,  fifth,  and  sixth  grade 
children.    She  described  her  procedure  in  this  manner: 

"A  twenty-four  hour  food  recall  was  obtained  during  the  first  inter- 
view.   Written  and  oral  instructions  and  food  models  were  used  to  improve 
the  accuracy  and  quantitative  estimates  and  to  minimize  possible  misinter- 
pretation about  what  foods  were  eaten  and  how  they  were  prepared.  Forms 
and  instructions  were  given  to  each  subject  for  recording  his  food  intake 
for  the  next  two  days.    Thiese  food  records  were  checked  with  the  subject 
as  soon  as  possible  after  completion. 

Several  aspects  of  this  procedure  helped  to  insure  the  accuracy  of 
the  data  obtained.    First,  it  was  not  necessary  for  the  homemaker  to  es- 
timate the  amount  eaten  by  a  single  person.    Amounts  were  estimated  in 
terms  of  that  prepared  for  the  total  family.    Thus,  it  was  possible  for 
the  homemaker  to  speak  in  terms  of  one  #2  can  of  green  beans  rather  than 
a  specific  number  of  cups  of  green  beans  and  to  report  that  her  family 
ate  a  2  lb.  loaf  of  bread  rather  than  trying  to  remember  the  number  of 
slices  consumed.    Secondly,  the  interviewer  visited  the  homemaker  every 
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day  to  help  her  record  the  information  as  accurately  as  possible.    If  the 

homemaker  had  not  completed  the  food  record,  the  interviewer  helped  her 

to  do  so.     If  she  had  completed  it,  the  interviewer  would  question  her 

about  food  items  that  she  might  have  forgotten  such  as  cream  in  coffee  or 

spread  on  bread.    She  would  also  try  to  insure  that  the  quantity  estimated 

was  as  accurate  as  possible  for  both  food  prepared  and  food  wasted.  Of 

course,  the  daily  visit  by  the  interviewer  insured  that  the  information 

was  indeed  recorded  daily.    Third,  foods  purchased  and  eaten  outside  the 

home  were  not  included  in  the  food  records. 

There  is  a  considerable  difference  of  opinion  concerning  the  minimum 

number  of  days  over  which  a  dietary  record  must  be  kept  to  yield  accurate 

information.    Chalmers  reports,  "Although  little  factual  information  is 

available  on  the  subject,  many  authorities  feel  that  a  dietary  record 

covering  a  period  of  seven  consecutive  days  with  twenty  consecutive  meals 

is  the  shortest  length  feasible  from  the  standpoint  of  accuracy.  However, 

field  units  operating  under  the  direction  of  the  U.S.  Public  Health  Service 

obtained  dietary  information  by  use  of  the  one  day  dietary  record.  They 

believed  that  a  larger  number  of  accurately  taken  one-day  records  are  as 

useful  as  the  smaller  number  of  seven  day  records. 

Chalmers  goes  on  to  report,  "By  use  of  variance  components  it  was 

found  that  a  dietary  record  need  consist  of  only  one  day  when  character- 
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Izing  the  dietary  intake  of  a  group."       Similarly,  Young  has  reported, 
"The  pattern  of  the  daily  means  for  the  group  proved  sufficiently  stable 
to  suggest  that  even  less  than  a  week^s  record  would  have  provided  an  es- 
timate  of  intake  with  little  loss  in  precision. "^"^ 

With  this  in  mind  and  with  an  appreciation  of  the  economic  and  time 
constraints  under  which  we  were  working,  it  was  decided  that  a  three-day 

ERIC 
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dietary  appraisal  would  be  most  suitable  for  this  evaluative  study. 

Nutrition  Knowledge  Data 

Knowledge  of  nutrition  has  been  ascertained  in  the  past  for  a  variety 
of  reasons.    Young^^  related  nutritional  knowledge  to  certain  socio-econ- 
omic factors  of  homemakers.    She  was  also  interested  in  determining  the 
area  of  most  inadequate  nutrition  knowledge.    Wang^^  examined  the  differ- 
ences in  nutrJ  tion  knowledge  exhibited  by  homemakers  of  different  income 
levels  and  teenaga  youth.    Eppright^^  examined  the  relationship  between  a 
mother's  nutrition  knowledge  and  her  attitude  toward  meal  planning,  food 
preparation,  nutrition,  and  permissiveness  in  feeding  children.  Peterson^'' 
examined  the  nutrition  knowledge  of  elementary  school  teachers  as  it  re- 
lated to  their  approaches  to  achieving  desirable  food  behavior  changes  in 
young  children. 

Young,  Eppright,  and  Peterson  used  procedures  in  which  the  respondents 
indicated  that  a  series  of  items  were  either  true,  false,  or  don't  know. 
Eppright  and  Peterson  allowed  the  respondent  to  indicate  ti-^.  degree  of 
certainty  or  uncertainty  about  her  response.    Young  utilized  a  procedure 
of  ninety-six  open-end  questions  which  were  completed  in  the  course  of 
an  Interview.  • 

For  the  purposes  of  this  study  the  respondent's  knowledge  of  nutri- 
tion was  assessed  by  means  of  two  queutiona,  one  of  which  had  six  sub- 
questions.    The  first  question  asked  the  respondent  to  identify  two  foods 
from  a  list  of  ten  that  would  provide  food  value  similar  to  that  or  milk. 
The  two  correct  choices  were  cheese  and  ice  cream.    Among  the  eight  in- 
correct answers  were  two  beverages ,  so  the  persons  who  view  milk  simply 
as  a  beverage  might  choose  them  as  the  correct  response.    Also  among  the 
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incorrect  responses  were  foods  that  were  nutritious  but  which  do  not  con- 
tain the  same  kind  of  food  value  as  milk.    These  foods  might  be  chosen  by 
a  person  who  simply  views  milk  as  "good  for  you."    The  other  incorrect 
responses  were  foods  that  simply  fill  your  stomach.    These  might  have  been 
chosen  by  persons  who  view  milk  simply  as  the  hunger  quencher* 

The  second  question  asked  the  respondent  to  choose  the  more  nutritious 
food  from  each  of  six  pairs  of  foods.    Each  pair  contained  a  food  relatively 
high  in  nutrients  and  one  relatively  low  in  nutrients.    Included  were  two 
pairs  of  vegetables,  one  pair  of  fruits,  one  pair  of  meats,  one  pair  of 
snack  foods,  and  one  pair  consisting  of  a  protein  food  (cottage  cheese)  and 
a  food  advertised  as  protein  (jello). 

These  two  questions  afford  the  respondent  eight  opportunities  to  re- 
veal her  understanding  of  food  nutrients.    In  scoring  the  answers,  the  re- 
spondent received  one  point  for  each  correct  answer  for  a  possible  total 
score  of  eight. 

Food  Buying  Skills 

The  respondent's  knowledge  of  food  buying  was  also  assessed.  Two 
questions  were  used.    The  first  question  had  two  parts.    The  first  part 
dealt  with  buying  canned  tomatoes  and  the  other  with  buying  a  loaf  of  bread. 
A  card  picturing  the  labels  of  two  cans  of  tomatoes  was  handed  to  the  re- 
spondent who  was  asked  to  select  the  brand  she  would  purchase  for  use  in 
preparing  soup.    Brand  X  tomatoes  were  identified  as  "Whole — Hand  Selected" 
and  the  can  weighed  Hk  ounces.    Brand  Y  tomatoes  were  not  identified,  but 
the  can  weighed  16  ounces.    The  cans  were  said  to  cost  the  same.    A  similar 
procedure  was  used  to  determine  which  loaf  of  bread  the  respondent  woul 
purchase.    The  two  loaves  weighed  and  cost  the  same.    One  was  labeled 
"Enriched"  and  the  other  "Brick  Oven  Baked."    The  respondent  was  to  state 
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why  she  favored  the  food  chosen.    She  received  one  point  if  she  chose  the 
correct  can  of  tomatoes  or  loaf  of  bread  for  tbe  correct  reason. 

The  second  question  on  food  buying  dealt  with  buying  milk.    The  re- 
spondent was  asked  which  was  most  expensive:    fresh  fluid  milk,  canned 
evaporated  milk,  or  dry  powdered  milk.    She  was  then  asked  which  was 
least  expensive.    She  received  one  point  for  each  correct  response. 

Factors  Related  to  Family  Foo^  Consumption 
A.    Characteristics  of  the  Homemaker 

Questions  were  developed  to  obtain  background  data  from  each 
homemaker.    These  questions  were  designed  to  serve  as  independent 
variables  in  exploring  answers  to  the  second  objective  of  this 
study.    That  is,  they  were  to  be  used  to  determine  if  there  are 
any  characteristics  which  distinguish  those  program  families 
with  suitable  diets  from  those  with  less  adequate  diets.  Ques- 
tions concerning  the  homemaker 's  race,  age,  education,  family 
income,  mass  media  awareness  and  participation  in  food  assistance 
and  public  feeding  programs  were  designed  to  indicate  who  the 
homemaker  is.    These  data  were  gathered  on  the  assumption  that 
who  the  homemaker  is  is  closexy  intertwined  with  what  she  does. 

The  data  collected  do  not  make  it  possible  to  assess  the 
differing  degrees  of  change  in  dietary  habits  experienced  by 
different  program  families.  It  is  only  possible  to  conclude 
that  at  the  time  of  the  study,  there  were  differences  in  the 
adequacy  of  the  diets.    However,  examining  characteristics  which 


distinguished  families  whose  diets  are  of  differing  adequacy 
may  provide  some  insight  into  the  factors  which  underlie  and 
influence  food  consumption.    The  success  of  education  in  nu- 
trition and  thus  the  success  of  the  Expanded  Food  and  Nutri- 
tion Education  Program  is  dependent  upon  knowledge  and  under- 
standing of  the  factors  which  influence  food  consumption. 
Reh  has  said,  "The  investigation  of  food  consumption  and  its 
evaluation  are  in  themselves  not  enough.    The  background  of 
the  consumers  must  be  studied  and  understood.    Relevant  and 
valuable  economic,  agronomic,  and  social  data  can  and  should 
be  collected  during  food  consumption  surveys.  Consumption 
surveys  are  not  made  to  satisfy  curiosity  about  what  people 

eat;  they  are  made  to  provide  a  basis  for  measures  to  improve 
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food  consumption  in  dietary  practices," 

The  first  objective  of  this  study  will  proN^ide  an  answer 
about  the  effectiveness  of  the  Expanded  Food  and  Nutrition 
Education  Program  in  Missouri,    The  second  objective  will 
provide  help  in  planning  future  educational  programs  in  nu- 
trition.   Ms.  Reh  has  also  said,  "The  mere  knowledge  of  per 
capita  ,food  consumption  and  the  nutritional  adequacy  of  the 
diet  is  insufficient  for  planning  practical  program^  for 

improvement  of  the  diet.    Socio-economic  and  other  data 
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are  required  concerning  the  food  consumption  group,"  Thus, 
information  about  characteristics  which  distinguish  program 
families  whose  diets  are  adequate  will  be  useful  in  planning 
for  the  future  of  the  Expanded  Food  and  Nutrition  Education 
Program, 
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Age 

It  was  hypothesized  that  the  age  of  the  homemaker 
would  be  related  to  the  quality  of  her  family's  diet. 
Specifically,  it  was  hypothesized  that  the  younger  the 
homemaker,  the  better  the  diet  of  her  family  would  be. 
Young  and  her  associates  found,  ''The  young  homemakers 
(under  40  years)  appeared  to  do  a  somewhat  better  job 
in  feeding  thiir  families  than  the  middle-aged  (40-60 
years)  or  old  (over  60  years)  homemakers. '*^° 

Similarly,  Sanjur  and  Scoma  found  that  the  mother's 

age  was  negatively  associated  with  the  child's  food  in- 
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take.       Of  course,  there  is  nothing  inherent  in  the 
aging  process  which  would  make  one  less  inclined  to  feed 
one's  family  adequately.    Therefore,  it  must  be  assumed 
that  the  relationship  between  age  and  adequacy  of  diet 
is  in  fact  being  caused  by  some  additional  factor  such 
as  the  younger  homemaker 's  greater  education  or  her 
greater  awareness  of  nutrition  information.    However,  in 
the  case  of  the  Expanded  Food  and  Nutrition  Education 
Program  homemakers,  both  young  and  older  homemakers  are 
exposed  to  nutrition  information.    Therefore,  if  the 
hypothesized  relationship  between  age  and  adequacy  of 
diet  is  found,  it  may  be  due  to  younger  homemakers' 
greater  willingness  to  accept  the  principles  taught  by 
the  Nutrition  Education  Assistant. 

In  a  study  of  the  social  and  psychological  factors 


23 

associated  with  the  acceptance  of  new  food  products  in 
Pennsylvania,  Bylund^^  found  that  those  homemakers  who 
were  most  willing  to  try  new  foods  vere  younger  than 
those  who  were  less  willing.    He  suggests  that  due  to 
physiological,  psychological,  anJ  sociological  reasons 
the  tendency  to  try  new  food  products  drops  sharply 
with  a^e. 
Education 

It  was  hypothesized  that  the  greater  a  homemaker ' s 
educational  level,  the  more  adequate  would  be  the  diet 
that  she  served  her  family*    Davis  reviewed  the  studies 
of  vitamin  and  mineral  nutrition  in  the  United  States 
between  1950  and  1968  and  reported,  "A  number  of  studies 
examined  the  relationship  between  educational  level  and 
dietary  and/or  biochemical  data.    Several  of  these  found 

a  direct  relationship  in  that  individuals  with  a  higher 
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educational  level  appeared  to  have  better  nutrition." 
Young  found,  "lu  general,  homemakers  who  graduated  from 
high  school  had  only  some  high  school  and  these  in  turn 
have  better  practices  than  those  who  attended  grade 
school  only.    With  increased  education  a  higher  per- 
centage of  homemakers  used  all  seven  of  the  basic  food 
groups  in  their  menus. 

The  hypothesized  relationship  between  education 
and  dietary  adequacy  is  based  on  the  assumption  that 
the  greater  one's  educational  level,  the  greater  the 
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chances  that  one  would  have  encountered  nutritioril  in- 
formation and  the  greater  will  be  cue's  awareness  of 
the  nutrition  Infonration  that  is  presented  through  the 
mass  media • 

It  could  be  argued,  of  course,  that  all  homemakers 
who  are  in  the  Expanded  Food  and  Nutrition  Education 
Program  have  received  education  about  nutrition  and 
thus  their  original  educational  level  should  have  no 
influence  upon  their  dietary  adequacy.    This  argument 
would  be  based  on  the  assumption  that  education  about 
a  subject  leads  to  action  on  that  subject.  However, 
this  i3  not  necessarily  ?o.    The  number  of  years 
of  formal  education  obtained  by  a  homemaker  is  probably 
a  good  indication  of  her  willingness  to  learn.  Thus, 
those  homemakers  with  more  education  would  be  more  wl  1-- 
ing  to  learn  from  the  Nutrition  Education  Assistant  and 
thus  more  likely  to  feed  their  families  mo-  adequately. 
Bylund^^  did,  in  fact,  find  such  a  relationship  in  his 
study. 

It  was  not  expected  that  the  educational  level  of 
the  program  homemakers  in  this  study  would  cover  a  very 
large  range.    This  is  due  to  the  fact  that  the  program 
homemakers  have  low  incomes  and  low  income  tends  to  be 
associated  with  lowe*r  educational  levels.    Indeed,  as 
of  March,  1972,  the  month  in  which  this  evaluative  study 
was  conducted,  eighteen  percent  of  the  program  homemakers 
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had  an  eighth  grade  or  less  education.    However,  it 
was  expected  that  the  anticipated  relationship  between 
education  and  dietary  adequacy  could  be  observed  even 
within  a  narrow  range  of  educational  level. 
Income 

Although  all  of  the  homemakers  in  the  Expanded  Food 
and  Nutrition  Education  Program  are  supposed  to  have  low 
incomes,  it  was  hypothesized  that  within  the  narrow  range 
represented  by  program  families,  there  would  be  a  direct 
positive  relationship  between  income  and  d7.etary  adequacy* 
In  his  review  of  studies,  Davis  found  that  a  direct  rela- 
tionship apparently  exists  between  income  and  diet  with 
higher  income  groups  having  better  diet  than  low  income 
groups.    This  appears  to  be  true  even  in  a  narrow  low  in- 
come range.    Davis  reporte'^  on  a  study  which  examined 
296  families  with  incomes  ranging  from  less  than  $500 
to  over  $3000  by  class  intervals  of  $500.    In  this  study 
there  was  a  direct  relationship  between  income  and  in- 
take of  calcium,  vitamin  a,  and  vitamin  C,  with  less 
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clear  relationships  with  other  nutrients.       The  USDA 
1955  and  1965  nationwide  surveys  of  the  nutrient  value 
of  food  purchases  found  that  for  all  nutrients  there 
was  an  inverse  relationship  between  the  percentage  of 
households  whose  purchases  were  below  the  RDA  and  income. 

In  the  report  by  tlie  Citizens'  Board  of  Inquiry  in 
Hunger  and  Malnutrition  in  the  United  States,  it  was 
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said  "Consumer  education — to  be  effective — requires  two 
critical  ingredients:    (1)  adequate  purchasing  power 
which  can  then  be  used  more  "wisely"  and  effectively; 
and  (2)  a  relevant  body  of  knowledge,  teaching  tech- 

97 

niques.  and  pedagogical  approaches.""^'    The  Expanded 
Food  and  Nutrition  Education  Program  does  not  increase 
the  purchasing  power  of  the  program  families  by  giving 
them  direct  payments.    Therefore,  it  was  assumed  that 
those  with  more  adequate  purchasing  power  would  be  in  a 
position  to  more  wisely  and  effectively  use  the  knowl- 
edge that  the  Nutrition  Education  Assistant  brings  to 
them. 

These  three  variables — age,  education,  and  income — 
are,  of  course,  intimately  intertwined.    Both  Young  and 
Eppright  reached  the  conclusion  that  education  level  of 
a  homemaker  is  more  important  than  her  income  level  in 
determining  dietary  adequacy.    Young  says,  "Though  in- 
creases in  income  level  brought  some  increase  in  the 
adequacy  of  eating  practices  both  qualitatively  and 
quantitatively,  the  increases  were  neither  as  consistent 
nor  as  great  as  increases  in  education  level.    That  the 
effect  which  was  present  probably  was  primarily  one  of 

education  was  shown  by  simultaneous  examination  of  the 
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effects  of  both  education  and  income."  Young  also 
found  that  the  observed  relationship  between  age  and 
nutrition  knowledge  was  actually  a  mere  reflection  of 
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the  relationship  between  educational  level  and  nutrition 

knowledge. 

Race 

Davis  reports  that  there  is  conflicting  evidence 
about  the  influence  of  a  racial  difference  on  dietary 
adequacy.    However,  this  conflicting  evidence  could  be 
produced  by  a  failure  to  control  certain  other  variables 
such  as  income  and  education  that  tend  to  be  associated 
with  race.    Yet,  Davis  reports  on  two  studies  in  which 
these  other  variables  appear  to  be  controlled  and  yet 
conflicting  conclusions  are  still  reached.    He  reports 
that  Delgado  studied  migrant  Negro  families  and  found, 
"The  percentage  of  families  whose  intakes  were  below 
various  levels  of  RDA  was  significantly  higher  than 
those  in  other  household  studies. "^^    Thiele  also  studied 
Negro  migrant  workers  and  "found  biochemical  indices  of 
nutrition  which  were  similar  to  those  found  in  other 
studies. "30 

The  hypothesis  for  this  study  was  based  upon  the 

second  report  by  the  Citizens  Board  of  Inquiry  into 
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Hunger  and  Malnutrition  in  the  United  States. Pre- 
liminary results  of  this  ten-state  nutrition  survey  in- 
dicated that  in  the  low  income  states  of  Texas, 
Louisiana,  Kentucky  and  West  Virginia  and  South  Carolina, 
by  any  measure  used,  black  families  have  a  poorer  nutri- 
tional status  than  white  families. 
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Mass  Media  Awareness 

It  is  sometimes  said  that  low  income  persons  tend 
to  be  isolated  from  the  general  society.    It  was  h:  o- 
thesized  that  homemakers  who  overcame  this  isolation  to 
some  extent  by  reading  newspapers  and  magazines  and  by 
listening  to  radio  and  television  would  serve  their 
families  more  nutritionally  adequate  meals.    This  hypo- 
thesis is  based  on  the  fact  that  these  communication 
channels  are  often  employed  to  distribute  information 
about  and  stimulate  interest  in  foods  and  nutrition. 

Sanjur  and  Scoma^^  asked  mothers  to  rank  the  sources 
of  information  which  they  felt  had  the  greatest  influ- 
ence on  their  eating  practices.    The  lowest  rank  was 
given  to  "printed  materials."    The  highest  ranking  was 
given  to  their  own  mother  and  other  relatives.  However, 
none  of  the  sources  of  information  which  the  mothers 
were  asked  to  rank  were  of  a  mass  media  nature,  such  as 

radio  and  television.    It  is  also  unclear  exactly  what 

33 

printed  materials  were  considered.    Bylund      found  that 
homemakers  who  adopted  more  food  practices  were  in  ^act 
the  ones  who  made  "a  great  deal"  of  use  of  the  mass  media 
sources  of  magazines  and  newspapers. 
Participation  in  Food  Assistance  Programs 

There  is  some  evidence  that  participating  in  a 
federally  sponsored  food  assistance  program  does  not  in- 
crease the  nutritional  adequacy  of  the  diets  of  low 
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income  families.    Madden  and  Yoder^^  studied  the  impact 
of  food  stamps  and  commodity  distribution  on  the  dietary 
adequacy  of  low  income  families  in  rural  Pennsylvania. 
They  found  that  the  families  receiving  commodity  foods 
had  no  better  diets  than  similar  families  who  did  not  re- 
ceive commodity  foods.    They  also  found  that  food  stamps 
had  a  positive  impact  on  the  dietary  adequacy  of  a  family 
only  under  very  unfavorable  conditions.    They  concluded 
that,  in  general,  families  who  received  food  ..osistance 
do  not  continue  to  spend  the  same  amount  of  money  on  food 
as  they  did  in  the  past,  but  in  fact,  they  reduce  their 
food  expenditure  and  use  the  money  for  something  else, 
thus  maintaining  the  same  level  of  food  coming  into  the 
house  and  therefore  the  same  level  of  dietary  adequacy. 

A  report  by  Feaster^^  noted  that  at  the  time  of  en- 
rolling in  the  Expanded  Food  and  Nutrition  Education 
Program  the  dietary  practices  of  families  participating 
in  federally  sponsored  food  programs  was  similar  to  that 
of  the  families  not  participating  in  a  food  assistance 
program.    However,  this  report  noted  that  after  six  months 
of  participating  in  the  Expanded  Food  and  Nutrition  Edu- 
cation Program,  the  program  homemakers  had  made  important 
improvements  in  the  dietary  adequacy  of  their  families. 
-Thus,  it  was  hypothesized  that  those  program  families 
whose  diets  were  better  would  be  the  ones  who  were  par- 
ticipating in  a  federally  sponsored  food  assistance 
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program.    This  hypothesis  is  based  on  the  assumption 
that  if  a  family  were  utilizing  money  that  could  be 
spent  on  food  for  other  family  expenses,  then  upon 
learning  of  the  necessity  to  eat  adequately,  it  would 
be  possible  for  them  to  move  that  money  to  food  purchases 
and  thus  to  improve  the  adequacy  of  their  diet. 
7.    Participation  in  Public  Feeding  Programs 

Although  the  food  eaten  outside  the  home  was  not 
used  in  calculating  the  dietary  adequacy  of  the  families 
who  participated  in  this  evaluative  study,  it  was  felt 
that  food  eaten  outside  of  the  home  at  one  of  the  feder- 
ally sponsored  feeding  programs  such  as  school  lunch  or 
Head  v. tart  breakfast  was  indicative  of  a  positive  attempt 
to  improve  family  diet.    It  was  assumed  that  homemakers 
who  encourage  their  children  to  participate  in  these 
feeding  programs  would  also  be  interested  in  improving 
the  adequacy  of  the  food  consumed  in  the  home.  There- 
fore, it  was  hypothesized  that  those  families  who  par- 
ticipated in  the  federally  sponsored  feeding  program 
would  be  the  ones  with  the  more  adequate  nutritive  intake. 
B.    Characteristics  of  the  Program 
1.    Frequency  of  NEA  Visits 

There  is  conflicting  evidence  about  the  influence  of  the 
frequency  of  visits  from  the  Nutrition  Education  Assistant 
upon  the  dietary  adequacy  of  a  family.    Madden  and  Yoder  con- 
cluded that  their  analyses  "do  not  indicate  any  significant 
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difference  in  adequacy  of  dietary  intake  related  to  the  numr 
ber  of  nutrition  aide  visits ,"36    However,  fewer  than  10%  of 
the  homemakers  that  they  interviewed  were  participating  in 
the  Expanded  Food  and  Nutrition  Education  Program  and  this 
sample  was  probably  too  staall  to  allow  a  definitive  conclu- 
sion to  be  drawn. 

Feaster  reported  that  at  the  end  of  six  months  partici- 
pation in  the  Expanded  Food  and  Nutrition  Education  Program, 
"the  amount  and  intensity  of  food  anu  nutrition  education  re- 
ceived by  a  homemaker — measured  by  number  of  program  aide 
visits  between  food  readings — had  a  positive  effect  on  diet 
improvement."^^    For  purposes  of  this  study  it  was  hypothesized 
that  program  families  with  a  more  adequate  diet  would  be  the 
ones  who  had  been  more  frequently  visited  by  their  Nutrition 
Education  Assistant. 
Tenure  in  Program 

Attempting  to  Lnprove  the  adequacy  of  a  family's  food 
consumption  is  not  clear  cut.    Questions  arise  as  to  how  long 
one  should  spend  attempting  to  improve  adequacy.    There  is 
also  the  question  of  what  constitutes  improvement.  Differing 
answers  to  these  questions  result  in  differing  beliefs  about  ~ 
how  long  a  family  should  be  enrolled  in  the  program.    An  ex- 
amination of  the  food  recall  data  that  are  gathered  every  six 
months  indicates  that  in  terms  of  recommended  minimum  serv- 
ings, program  homemakers  make  little  improvement  in  their 
family's  food  consumption  beyond  eighteen  to  twenty-four 
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months  of  program  participation.    This  is  in  keeping  with 
the  results  of  an  analysis  made  by  the  Synectics  Corporation*^^ 
which  found  that  even  homemakers  who  initially  were  serving 
their  families  only  half  or  less  of  the  recomiaended  minimum 
servings  should  be  able  to  make  sufficient  progress  in  one 
or  two  years  of  participation  to  assure  that  they  had  received 
the  full  potential  from  the  program.    A  similar  finding  was 
reported  in  a  study  done  in  Tennessee  in  1971-    The  report 
of  that  study  said  "Theie  appeared  to  be  no  significant  re- 
lationship between  length  of  time  the  families  had  been  in 
the  program  and  percents  of  homemakers  with  adequate  servings 
from  the  food  groups. 

However,  the  Nutrition  Education  Assistants,  the  persons 
who  work  most  directly  with  the  families,  assure  us  that  there 
is  a  reason  to  keep  a  family  in  the  program  beyond  two  years. 
They  tell  us  that  sometimes  progress  is  made  very  slowly,  but 
that  progress  is  indeed  made.    Due  to  this  dispute,  it  was 
decided  to  examine  the  effect  of  tenure  upon  the  adequacy  of 
a  program  homemaker's  family  food  consumption. 

Food  Frequency  Data* 

An  important  fact  about  most  studies  of  nutritional  adequacy  is  that 
they  have  focused  upon  the  level  of  nutrient  intake  of  an  individual  or  a 
group.    The  methods  used  have  included  those  previously  mentioned.  These 

*  Assistance  in  writing  this  section  was  given  by  Ann  aertzler,  Assistant 
Professor  of  Foods  and  Nutrition,  State  Foods  and  Nutrition  Specialist, 
University  of  Missouri. 
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methods  tend  to  be  expensive  in  both  the  time  and  money  necessary  to  ob- 
tain and  analyze  food  information.    This  tends  to  maLe  them  inappropriate 
for  studying  a  large  number  of  persons  at  one  time.    These  methods  also 
require  a  great  deal  of  cooperation  on  the  part  of  the  person  from  whom 
dietary  information  is  being  obtained.    Consequently,  investigators  are 
interested  in  a  le'5S  expensive,  yet  accurate  method  of  assessing  the  dietary 
adequacy  of  a  large  number  of  persons.    It  is,  of  course,  possible  to 
describe  cietary  habits  in  terms  other  than  nutrient  intake.    These  descrip- 
tions "car  be  made  according  to  many  variables,  among  which  are  the  spacing 
and  pattern  of  food  intakes,  the  environment  in  which  the  food  is  eaten, 
the  speed  of  eating,  the  changes  in  food  habits,  and  the  frequency  that 
foods  are  consumed. 

Information  about  the  frequency  with  which  foods  are  consumed  is 
usually  obtained  by  an  interview.    The  method  is  particularly  useful  when 
it  is  desirable  to  obtain  information  about  the  characteristic  diet  over 
a  long  period  of  time.    Several  researchers  have  used  the  food  frequency 
interview.    Chassy,  van Veen,  and  Young^^  developed  scales  of  diet  complexity 
based  upon  the  frequency  with  which  certain  groups  of  food  were  eaten. 
Abramson,  Slome,  and  Kosovsky^^  found  a  significant  relationship  between 
the  frequency  with  which  foods  were  eaten  by  a  heterogeneous  sample  of 
pregnant  women  and  their  hemoglobin  level.    They  also  found  that  the  fre- 
quency with  which  a  food  is  eaten  is  a  reasonably  good  indicator  of  the 
quantity  consumed. 

Results  obtained  by  the  use  of  the  food  frequency  interview  method 
have  been  compared  with  the  results  obtained  by  other  methods   of  assessing 
dietary  adequacy.    Stefanik  and  Trulson  compared  the  results  obtained  by 


34 

using  the  food  frequency  interview  to  those  obtained  by  using  a  seven-day 
diet  record  and  by  using  research  histories.    They  found  "In  expressing 
dietary  data  from  the  coded  diet  interview  in  terms  of  food  eaten  at  the 
rate  of  once  per  week  or  less  and  those  eaten  over  this  amount,  informa- 
tion comparable  to  that  found  by  the  diet  record  technique  and  a  more  de~ 
tailed  research  history  was  obtained...  The  three  approaches  to  attempt  at 
validation  yielded  favorable  results  which  supported  the  belief  that  a 
shorter  interview  method  with  coded  responses  could  be  used  to  obtain 
base-line  descriptive  dietary  information  on  large  sample  of  men  with  fair 
accuracy  relative  to  two  established  techniques."       Thomas  and  her  asso- 
ciates      obtained  seven-day  food  intake  records  and  twenty-four  hour  re- 
call records  from  a  group  of  pregnant  women.    These  data  were  simplified 
into  food  frequency  data  by  recording  the  number  of  servings  of  foods  in 
various  food  groups  that  the  wouen  had  eaten.    This  method  of  appraising 
dietary  intake  of  women  was  successfully  compared  to  results  obtained  by 
records  of  chemical  analyses  of  diets  eaten  by  mothers  and  children;  with 
records  from  direct  calculations  with  tables  of  food  composition;  and  with 
records  of  dietary  intake  obtained  and  rated  in  another  laboratory. 
A.    The  Use  of  Fruits  and  Vegetables  by  Low  Income  Persons 

Kelsay  reviewed  the  studies  dealing  with  nutritional  status 
and  dietary  evaluation  which  were  conducted  in  the  United  States 
between  the  years  of  1957  and  1967.    She  concluded,  "In  the 
dietary  evaluation  studies,  on  the  wh^ie,  ascorbic  acid,  vitamin  A, 

calcium,  and  iron  were  the  nutrients  most  commonly  found  in  the 
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diets  in  amounts  below  the  Recommended  Dietary  Allowances. 

A  review  of  the  studies  of  vitamin  and  mineral  nutr.'tion  in 


35 

the  United  States  between  1950  and  1968^^  found  that  for  all  nu- 
trients studied  there  was  an  inverse  relationship  between  the 
percentage  of  households  whose  purchases  were  below  the  Recom- 
mended Daily  Allowances  and  income.    This  was  particularly  true 
for  vitamin  C,  ^vitamin  A,  and  calcium. 

In  an  in-depth  analysis  of  the  impact  of  the  Expanded  Food 
and  Nutrition  Education  Program  on  low  income  families,  Feaster^^ 
found  that  when  homemakers  first  enrolled  in  the  program,  only 
fourteen  percent  of  them  were  consuming  an  adequate  amount  of 
fruits  and  vegetables  each  day.    At  the  end  of  six  months  of  pro- 
gram participation,  twenty-eight  percent  were  consuming  an  ade-- 
quate  amount  of  fruits  and  vegetables.    Although  this  increase  is 
highly  significant,  even  at  the  end  of  six  months  the  consumption 
of  fruits  and  vegetables  was  considerably  less  adequate  for  all 
the  homemakers  than  was  the  consumption  of  any  of  the  other  four 
food  groups. 

This  same  trend  is  observable  in  the  data  from  the  State  of 
Missouri.    Data  obtained  from  the  food  recalls  of  program  home- 
makers  indicate  that  twenty-six  percent  of  the  homemakers  had  an 
adequate  consumption  of  fruits  and  vegetables  when  enrolled  and 
only  thirty-five  percent  ate  enough  of  these  roods  after  three 
years  of  program  participation.    Regardless  of  the  length  of  par- 
ticipation in  the  Expanded  Food  and  Nutrition  Education  Program, 
the  consumption  of  fruits  and  vegetables  is  always  the  most  in- 
adequate in  relation  to  the  other  three  basic  food  groups. 
The  Present  Study 
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The  frequency  with  which  the  subjects  of  this  evaluative 
s  idy  consumed  fruits^and  vegetables  containing  vitamin  A  and 
vitamin  C  was  obtained.    The  purpose  for  obtaining  this  informa- 
tion was  (1)  to  determine  whether  program  families  consumed  fruits 
and  vegetables  containing  vitamin  A  and  vitamin  C  more  frequently 
than  nonprogram  families;  (2)  to  determine  if<?the  families  whose 
diets  were  judged  to  be  adequate  by  means  of  the  food  record  were 
the  same  families  who  were  frequently  consuming  fruits  and  vege- 
tables; and  (3)  to  identify  the  fruits  cxud  vegetables  that  are 
familiar  to  Missouri  families. 

The  interviewers  were  instructed  that  in  gathering  the  food 
frequency  data  they  were  to  record  the  consumption  of  a  given 
food  in  any  form.    This  procedure  was  based  on  the  assumption 
that  families  more  familiar  with  a  given  flavor  would  be  more 
likely  to  use  the  food  in  a  variety  of  forius  and  that  providing 
the  food  in  the  home  indicates  unat  the  family  members  recognize^ 
the  item  as  food. 

Coding  the  Data 

All  data  in  this  study  were  coded  by  a  small  group  of  senior  students 

majoring  in  nutrition  at  the  University  of  Missouri.    All  foods  consumed 

by  a  given  family  during  the  seventy-two  hours  covered  by  this  study  were 

recorded  in  terms  of  grams  of  edible  foods.    The  amounts  of  food  consumed 

by  the  family  had  been  recorded  by  the  homemakers  in  terms  of  household 

measures.    These  were  converted  into  grams  of  edible  food  on  the  basis  of 
/  ft 

available  data.       The  dietary  needs  of  a  family  were  determined  by  each 
family  member's  age  and  sex.    The  dietary  needs  of  an  adult  female  were 
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used  as  the  base  in  making  these  calculations.    The  dietary  needs  of  14 
other  categories  of  ages  and  sexes  were  developed  on  the  basis  of  this 
adult  female  standard. 

If  a  person  consumed  all  of  his  food  for  one  day  at  home,  he  was 
recorded  as  having  obtained  100%  of  his  dietary  needs  from  the  food  that 
was  consumed  by  the  family  during  that  day.    Each  of  the  major  three  meals 
consumed  during  the  day  was  assumed  to  contribute  twenty-five  percent  of  a 
person's  daily  dietary  needs.    Thus,  if  a  person  ate  one  of  these  three 
meals  away  from  home,  he  was  ^aid  to  have  obtained  twenty-five  percent 
less  than  a  100%  of  his  dietary  needs  f.ifilled  by  food  consumed  at  home. 
Each  of  two  snacks  that  were  measured  ii.  the  course  of  this  study  was  as- 
sumed to  contribute  to  10%  of  a  person's  daily  dietary  need.    If  a  person 
consumed  one  of  these  snacks  away  from  home,  it  was  said  that  he  received 
10%  less  than  a  100%  of  his  dietary  needr.  from  the  food  consumed  at  home. 

On  the  basis  of  this,  each  person's  percent  of  dietary  needs  to  be 
fulfilled  by  the  food  consumed  at  home  way  caJLctSlated .    If  a  guest  was 
present  and  ate  any  food  with  the  family,  that  guest's  age  and  sex  were 
recorded.    If  the  guest  ate  one  of  the  three  major  meals  with  the  famUy, 
it  was  coded  that  the  family  food  consumption  met  twenty-five  percent  of 
this  guest's  dietary  needs.    If  he  ate  a  snack  with  the  family,  the  family's 
food  consumption  met  10%  of  his  dietary  needs. 

The  Computer  Program 

A  computer  program  was  developed  at  the  University  of  Missouri  to 
process  the  information.    The  program  calculates  the  nutrient  conf.ent  of 
foods  as  listed  in  USDA  Handbook  No.  8,  "Composition  of  Foods."    In  addi- 
tion, the  program  includes  certain  foods  -hich  had  been  added  to  the 
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nutrient  file  by  the  Dietetics  Department  of  the  University  of  Missouri 
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Medical  Center <    The  program  provided  for  the  coraput  tions  of  .he  nutrient 
content  for  food  energy,  protein,  total  fat,  saturated  fat,  linoleic  acid, 
unsaturated/saturated  fat  ratio,  cholesterol,  carbohydrates,  iron,  vita- 
min A,  thiamine,  riboflavin,  vitamin  C,  niacin,  and  niacin  equivalent. 
The  program  also  computed  the  percent  of  the  r^  commended  dietary  allow- 
ance for  each  day  according  to  the  requirements  of  the  person  eating  that 
day  (requirements  are  determined  by  age  and  sex  of  those  consuming  the 
food) .    The  standard  dr^^iation  was  also  calculated  for  this  average  per- 
centage for  the  period  of  the  study. 
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CHAPTER  T 

.T  TRODUCTION 

Statement  of  tl:e  Problem 
Numerous  experiments  have  shown  that  group 
solutions  to  problems  are  inferior  to  those  made  by  . 
individuals.    It  has  been  demonstrated  that  inhibiting 
factors  are  involved  In  the  interaction  process  which 
may  prevent  groups  from  utilizing  all  the  resouces  avail- 
able to  them.    The  basic  underlying  assumptions  of  this 
study  were:     Groups  have  their  ov/d  immaturity  and  maturity; 
and  they  require 'training  as  groups  in  order  that  the 
factors  which  interfere  with  their  optimal  functioning  be 
alleviated.     It  was  the  purpose  of  this  study  to  investi- 
gate the  role  of  group  process  training  in  maximizing  the 
effectiveness  of  groups  in  solving  problems.    More  speci- 
fically, the  study  was  xocused  upon  (1)  comparing  the 
quality  of  interaction  of  a  group  which  has  unaergone  group 
process  training  with  the  quality  of  interaction  of  a  group 
which  has  not  had  group  process  training;  (2)  comparing  th^ 
quality  of  solutions  to  problems  jpojodjticed  by  a  group  which 
has  had  group  process  training  with  the  quality  of  solu- 
tions made  by  a  group  which  has  not  had  group  process 
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training;  (3)  comparing  the  cohesiveness  of  a  group  v/hich 
has  had  group  process  training  with  the  cohesiveness  of 
a  group  v;hlch  has  not  had  group  process  training;  and 
(J^)  comparing  the  gain  in_achievement  of  individuals  in  a 
group  which  has  had  group  process  training  with  the  gain 
in  achievement  of  individuals  in  a  group  which  has  not  had 
group  process  training. 

Significance  of  the  Problem 
Effective  membership  in  our  modern  democratic 
society  demands  participation  by  all  citizens  in  a  large 
and  increasing  quantity  of  interacting  groups.    The  number 
and  complex!!:'  of  problems  that  our  rapidly  expanding 
technology  thr^^sts  upon  us  makes  it'  imperative  that  v;e 
come  up  with  effective  solutions  to  these  problems* 
Increased  specialization  has  Drought  a  spiraling  accumula- 
tion of  knowledge,  but  much  of  this  knowledge  lies 
fragmented  among  the  various  specialists  in  their  fieldo. 
It  is  becoming  increasingly  clear  that  groups  of  specialists 
are  and  will  be  responsible  for  arriving  at  solutions  for 
the  problems  of  our  time:..    Until  we  acquire  experimentally 
grounded  knowledge  of  the  skills  that  are  necessary  for 
groups  to  interact  more  effectively  and  methods  to  gain 
these  skills,  we  fail  to  release  and  develop  the  intelli- 
gence and  produc  ivity  that  is  latent  in  groups. 

The  significance  of  this  study  is  that  it  will  pro- 
vide experimentally  grounded  knowledge  of  the  role  of  group 


process  training  in  maximizing  the  resources  that  a  problem 
solving  group  has  available  to  it.     If  group  process 
training  is  shov/n  to  have  posi:ive  effects  on  group  inter- 
action and  concomitantly  on  the  quality  of.  solutions  that 
the  group  is  able  to  produce,  then  individuals  who  desire 
the  grei.t^^st  utilization  of  the  problem  solving  abilities 
of  groups  will  have  a  method  to  help  ensure  the  success 
of  their  groups.    The  study  would  thus  have  far-reaching 
implications  for  adult  education. 


CHAPTER  III 


CONCEPTUAL  FRAMEWORK 

The  purpose  of  this  chapter  is  to  present  the  con- 
ceptual framework  for  this  invest^.gation*    In  addition, 
from  this  framework,  several  hypotheses  will  be  d.-'awn  for 
testing. 

A  review  of  the  relevant  literature  indicates  that 
there  are  a  number  of  factors  which  affect  the  quality  of 
a  group's  solutions  to  problems*    Among  the  most  inhibiting 
Is  the  lack  of  group  membership  skills  that  must  be  pos- 
sessed by  the  group  if  it  is  to  maximize  the  resources 
available  within  it.    There  are  basically  two  functions 
which  must  be  performed  if  a  group  is  to  be  effective  in 
solving  problems — the  task  function  and  the  group  mainte- 
nance function*    The  task  function  involves  facilitating 
and  coordinating  group  efforts  in  moving  toward  the  solution 
of  problems.    Newcomb,  Turner  and . Converse  (1965)  have 
stated  that  in  order  for  a  group  to  be  effective  in  solving 
problems-  it  must  have  members  who  are  able  to  perform  the 
following  behaviors  related  to  task  achieveme:it  : 

They  are  knowledgeable  about  matters  related  to  the 
task;-  they  are  imaginative,  innovative;  tliey  are  hard- 
headed,  realistic;  they  are  persuasive,  convincing 
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In  obtaining  group  consensus;  they  are  good  at  for- 
mulating problems  or  sumraarizing  discussions;  they  are 
skilled  in  planning,  organizing,  coordinating;  tney  can 
be  depended  on  to  carry  through  {p.  -^77). 

The  group  maintenance  function  involves  member  activities 

which  contribute  to  mak-iig  intermember  relationships 

satisfying.    Behaviors  that  are  directly  facilitative  in 

such  ways  include  the  following: 

providing  v/armth,  friendliness;  concilitating,  resolving 
conflict,  relieving  tension,  provicing  personal  help, 
counsel,  encouragement;  showing  understanding,  tolerance 

different  points  of  view;  shoviintS  fairness,  impar- 
tiality (Newcomb,  et_al • ,  1965,  p.  'iSl). 

The  achievement  of  a  group*"  goals  is  facilitated  to  the 

extent  that  it  has  members  who  have  the  skills  to  perform 

the  task  and  ghe  group  maintensmce  f uncti.cns , 

It  was  this  investigators  contention  that  the 

effective  performance  cf  the  task  and  group  maintenance 

functions  required  group  process  training.    Many  ind.  :iuuals" 

who  become  members  of  a  group  are  not  cognizant  that  both 

these  functions  need  to  be  performed  in  ord  -r  for  the  group 

to  move  toward  its  objectives  and  satisfy  the  needs  of  its 

members.    They  become  frustrated  in  group  r.ituations  when 

emotions  get  in  the  way  of  task  acaieveraent.  Struggles 

over  status,  lack  of  participation  on  the  part  of  some 

members;  domination  of  discussion  by  others;  expressions  of 

hostility  and  apathy  are  all  problems  whish  have  been 

reported  as  interfering  with  goal  achievement.    Even  when 

*an  individual  accurately  diagnoses  what  is  happ^  ning  in 
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the  group  and  attempts  to  facilitate  group  movement;  his 
efforts  may  not  be  "heard"  by  the  group.    For  one  thing, 
he  may  not  be  skilled  in  the  role*    Thus,  he  becomes  just 
one  more  skater  entering  an  already  overcrowded  rink. 
Then,  too,  the  other- group  members  may  not  perceive  his 
contribution  as  facilitating  because  of  the  group *s  over- 
emphasis on  content  rather  than  process. 

It  was  assumed  by  the  author  of  this  study  that 
group  process  training  would  provide  a  group  with  the 
necessary  skills  so  that  it  could  effectively  integrate 
the  task  and  group  maintenance  factors  deemed  by  Collins  and 
Guetzkow  (196^)  to  be  of  prime  importance  in  effective 
ppobJbem  solving.    They  asserted  that  one  of  the  conditions 
inherent  in  groups  which  serves  to  enhance  the  quality  of 
group  problem  solving  is  the  availability  of  a  relatively 
wider  range  of  information  and  ideas  which,  in  turn, 
increases  the  probability  that  the  ^:roup  members  will  hit 
upon,  more  adequate  solutions  to  problems  presented  to  it. 
A  group  which  has  been  trained  in  group  interaction  skills 
would  be  more  likely  to  employ  pra.ctices  which  would  facili- 
tate the  ekpression  of  ideas  and  opinions  from  all  members 
such  that  more  effective  use  could  be  made  of  their  avail- 
able member  resources.    Thus,  task  demands  v/ould  seem  to 
be  better  met  because  of  the  increased  number  of  resources 
engendered  by  a  more  equal  distribution  of  member  participa- 
tion and  the  accompanying  flexible  communication  patterns. 
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Similarly,  the  interpersonal  and  group  maintenance 
issues  of  importance  in  group  problem  solving  would  be 
likely  to  receive  greater  attention  by  a  group  trained  in 
the  functions  of  effective  group  membership.    Members  of  a 
trained  group  v/ould  experience,  greater  concern  about  the 
opinions  and  feelings  of  their  fellow  members.    There  would 
be  fev:er  attempts  by  members  to  satisfy  their  self-oriented 
needs  which  were  irrelevant  to  the  group  task  and  v;hich 
were  negatively  oriented  to  group  maintenance.  Through 
group  process  training  individuals  would  be  helped  gain 
the  skills  necessary  to  deal  with-  the  interpersonal  problems 
found  by  research  to  inhibit  group  effectiveness.  Thus, 
the  group  is  helped  to  utilize  the  resources  it  has  within 
Itself  to  become  more  effective  in  solving  its  problems. 

A  study  by  Rawls,  Rawls  and  Frye  (1969)  concluded 
that  members  v/ho  perceived  themselves  as  being  able  lo  per- 
form tasks  needed  by  their  groups  v/ere  more  satisfied  as 
group  members.    Thus,  training  in  the  functions  needed  by 
the  group  as  is  given  in  group  process  training  would  seem 
likely  to  enhance  member  satisfaction  of  those  involved 
in  the  training.    Because  a  group  trained  in  group  processes 
Is  more  likely  to  have  a  more  equal  dispersal  of  participa- 
tion among  its  members,  it  is  also  likely  that  its  members 
would  feel  a  greater  sense  of  responsibility  for  their 
group's  success  (Benne  and  Sheats,  19^8).    Then  too, 
because  the  interpersonal  and  group  issues  of  importance 
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are  more  likely  to  receive  attention,  members  in  the  trained 
group  might  be  expeci^ed  to.  experience  less  member  dissatis- 
faction and  frustration.    Thus,  it  might,  be  predicted  that 
individuals  v;ho  had  undergone  group  process  training  v/ould 
have  a  higher  group  cohesiveness  level — ^^feel  a  higher  sense 
of  attraction  to  the  group  and  thus  have  a  higher  level 
of  cohesiveness  than  v;ould  Individuals  who  had  not  received 
group  process  training* 

, Goldman  (1965)  found  that  groups,  regardless  of 
initial  ability,  are  superior  in  improvement  of  performance 
to  individuals  working  alone.    If,  as  Goldman  has  shown, 
groups  can  be  facilitative  of  learning,  might  it  not  follow 
that  a  group  trained  in  effective  membership  skills  might 
be  more  facilitative  of  learning  than  a  non-trained  group • 
Interpersonal  concerns  which  igight  interfere  with  learning 
would  also  seem  to  be  less  for  the  trained  group  which  has 
acquired  skills  to  resolve  them.    Therefore,'  individuals  in 
a  group  which  has  undergone  group  process  training  might 
be  expected  to  make  greater  gains  in  learning  than  a 
non-trained  group. 

Thus,  through  group  process  training,  individuals 
'gain  the  skills  to  work  with  other  group  members  in  creating 
a  climate  that  encourages  collaborative  problem  solving 
and  a  process  by  which  it  can  take  place.    Therefore,  the 
trained  group  could  be  expected  to  produce  qualitatively 
superior  products  as  well  as  demonstrate  higher  quality 
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interaction,  greater  satisfaction  with  the  group  and  higher 
gains  in  learning  achievement. 

On  the  basis  of  the  above  conceptual  framework,  the 
follov/ing  hypotheses  v/ere  empirically  tested  in  this  study: 

1.  A  group  v/hich  has  received  group  process  training 
will  evidence  a  significantly  greater  distribution 
of  participation  among  its  members  than  a  group 
which  .has  ,not>  rts-cajrved  group  proccst?  draining. 

2.  A  group  which  has  received  group  process  training 
.  will  make  a  significantly  smaller  percentage  of 

self-oriented  contributions  than  will  a  group 
•which  has  not> rocoivcd  group  process  training. 

3.  A  group  which  has  received  group  process  training 
will  make  a  significantly  higher  percentage  of 
group-oriented  contributions  than  will  a  group 
which  has  not-  received  gronp'^proces^s—tyajii^^ng. 

^1.    A  group  which  has  received  group  process  training 
.will  ..produae  a  significantly  higher  quality 
"philosophy-policy"  product  than  will  a  group 
which  has 'not  rpcei  ypA-gpettp^process^'Inrai'niftg. 

5.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Strategy"  product  than  will  a  group  which  has 
not  reeeivad-^gcaup^ji^^ 

6.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Criterion  System"  product  than  will  a  group 
which  has  not  raxxel^ved  RrouB^&roce&s-t^alaing. 

7..   A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Community-Level  Objectives"  product  than  will  a 
group  that  has  not  reee5rVa4_gc:ojup'-ppe^e^s 

8*    A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Analysis  of  a  Community-Level  Objective"  product 
than  will  a  group  which  has  not  i^ee±Yed--groufi_ 
ppeeess""tTaIrring . 
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A  group  which  has  received  group  process  training 
will  evidence  significantly  greater  group  cohe- 
siveness  than  will  a.  group  which  has  not  .j^eeeived 
giiQup^ -p^^wes^snEraining . 

Individuals  in  a  group  which  has  received  group 
process  training  will  exhibit  significantly 
greater  gains  in. achievement  in  course  content 
than  will  individuals  in  a  group  which  has  not 
re oeived-  grautr-prorceao  training • 


CHAPTER  IV 


METHODOLOGY 

0 

The  purpose  of  this  chapter  is  to  present  the 
methodology  followed  in  conducting  this  research.  Included 
are  (1)  Research  Design,  (2)  Assigning  Individuals  to 
Groups,  (3)  Treatment,  (^)  Instrumentation  and  (5)  Data 
Collection. 

Research  Design 
The  independent  variable  in  this  study  is  group 
process  training.    The  dependent  variables  are  group  prob- 
lem, solving,  group  cohesiveness,  and  individual  gain  in 
achievement;  and  the  intervening  variable  is  group 
interaction. 

The  vehicle  for  this  study  was  Dr.  Wayne  Schroeder's 
Program  Development  and  Evaluation  Course  (ADT  5^8)  which 
is  taught  during  the  summer  and  winter  quarters  at  Florida 
State  University.    The  course  utilizes  a  simulation-gaming 
device  developed  by  Dr.  John.  Snider  (1970)  as  his  disserta- 
tion.   A  preliminary  assumption  of  the  simulation-game 
strategy  is  that  a  community  council  has  been  established 
within  the  community,  "Microville,"  and  that  the  participanti 
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assume  the  various  roles  of  the  council  members  who  repre- 
sent community  agencies  that  offer  adult  education  programs. 
Registrants  for  the  course  are  divided  into  two  community 
councils  with  the  same  roles  in  each.    The  simulation -game 
experience  is  based  on  an  instructional  model  which  pro- 
vides the  participants  with  opportunities  to  identify  and 
utilize  those  concepts  most  relevant  to  program  development. 
The  experience  also  introduces  participajits  to  the  "social 
processes  involved  in  bringing  about  the  optimal  development 
of  programs.    The  instructional  tnodel  includes  the  following 
components:     (1)  Philosophy — each  council  must  come  up  with 
a  group  philosophy  of  adult  education  on  which  to  base  its 
.operations;  (2)  Strategy — .each  council  must  design  a  strategy 
for  identifying  the  needs  and  wants  of  "Microville"  including 
kinds  of  data  and  source  of  data;  (3)  Needs  and  Wants — each 
council  must  identify  the  needs  and  wants  of  the  various 
population  groups  within  their  community.    A  subcomponent 
of  this  phase  of  the  "game"  is  that  each  council  must 
analyze  the  data  in  order  to  establish  priorities  among 
the  needs  and  wants. 

The  fourth  component  of  the  Microville  simulation- 
game  is  that  each  council  must,  in  light  of  its  philosophy 
and  its  established  priorities  of  community  needs  and  wants, 
write  community -wide  objectives  for  an  adult  education 
program.    The  fifth  component  is  the  analysis  of  a  community- 
wide  objective  which  takes  cognizance  of  the  available 


29 

human,  physical,  and  financial  resources  that  are  available 
to  Microville  and  the  council's  philosophy- and  the  estab- 
lished priorities  for  needs  and  v/ants  (Snider  and  Schroder, 
1970,  pp.  5-^9)  •    There  are  other  components  of  the 
simulatiOix-game  as  developed  by  Snider,  but  they  deal  with 
projects  that  must  be  completed  by  council  members  working 
individually •    We  are  not  concerned  with  them  here  since 
we  are  only  interested  in  group  products. 

•For  each  of  the  above  components  or  problems,  each 
council  turned  into  the  game  administrator  its  written  solu- 
tion.   Thus,  there  were  five  written  group  products. 

Assigning  Individuals  to  Groups 
The  sixteen  individuals  who  registered  for  ADT  5^8 
during  the  winter  quarter  of  1972  constituted  the  sample 
selected  for  this  study.    In  assigning  these  individuals 
to  the  contro-l  or  the  experimental  groups^  g^n^at tempt  was 
made  to  pair  individuals  on  three  variables  which  research 
has  shown  to  affect  an  individual's  performance  in  a  group: 

(1)  personality  factors  having  to  do 'with  open  mindedness; 

(2)  previous  group  process  training  and/or  experience  in 
groups  and  (3)  entering  competency  (Cartwright  and  Zander, 
1968;  Goldman,  1965).    Accordingly,  during  the  first  class 
session  each  was  given  Rokeach's  Dogmatism  Scale,  Form  E 
which  Rokeach  (I96O)  described  as        .  .a  measure  of  the 
extent  to  which  the  total  mind  is  an  open  mind  or  a  closed 
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one"  (p.  397).    Validatl]on  studies  by  Zagona  and  Zurcher 
(1965)  furnish  data  to  ^upport  the  construct  validity  of 
the  Dogmatism  Scale.    Reliability  report,?  range  from  .68 
to  .93  with  a  median  of  U'i  for  intervals  ranging  from  one 
to  six  mont4- (Rokeacll,3,9^<r,  p.  90).    Secondly,  each  was 
given  a  questionnaire  designed  to  ascertain  how  much  previous 
group  training  or  group  experience  he  had  had.    In  addition, 
each  registrant  was  given. a  pre-test  of  program  development 
principles  to  determine  his  entering  competencies  in  the 

content  of  the  course.  -  '  -   "  - 

.  '        ;    The  data  in  Table  1  give  an 

indication  of  the  central  tendencies  of  the  resulting  scores 

on  the  control  variables. 

TABLE  1.— Measures  of  Central  Tendency  for  Control  Varia.  . 


•  Mean  Median  Range 


^ifiH^         126.5  117.5  86-180 


Previous  Group  Extensive  work  in  •  Minimal  previous 

Exoerlence       groups  and  no  prs-  work  in  groups  and 

Experience       gr^^P  ^^^^^  process  no  previous  group 

■   training  "  process  training- 

Extensive  experience 
working  in  groups 
and  previous  inten- 
sive group  process 
training  over  a 
three-year  period 


Pre -Test  Score    ^19. 8  .-58.0 


18-69 
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Because  of  the  small  number  involved  in  the  sample, 
those  above  the  median  on  each  of  the  pre-test  instruments 
were  placed  in  the  "high  scorer"  category  and  those  below 
in  the  lev;  category •    Six  matched  pairs  on  all  three  instru- 
ments V7ere  found*    Two  other  pairs  could  not  be  matched  on 
all  three  measures.    A-  decision  was  made  to  match  the  other 
two  pairs  on  the  basis  of  their  score  on  the  Dogmatism  Scale 
as  it  was  the  most  reliable  and  valid  measure  of  the  control 
variables.    Acco'^dingly ,  ■  two  pairs  were  matched  on  the  basis 
of  their  scores  on  the  Dogmatism  Scale  and,  as  It  happened, 
on  their  previous  group  training  and  experience  as  well. 
The  randomizing  technique  of  coin  tossing  was  used  through- 
out the  selection  procedure  in  deciding  which  member  of  each 
pair  was  designated  an  experimental'  subject  and  which  member 
was  designated  a  control  subject.    Table  2  shows  the  resultant 
distribution  of  the  scores  on  the  cpntrol  variables  between 
the  two  groups .    To  .heck  on  the  accuracy  of  the  matching 
procedure  an  analysis  was  made  of  the  differences  in  the 
scores  between  the  two  groups  using  the  Wilcoxon  Rank  Sum 
Test  (Wilcoxon  and  V/ilcox,  196^,  pp.  7-8).  Thie..i^ittel\was 
selected^,xeiti^^,.^^  ot<t^p 
indepQnid^nt-s^ple8--of  iTlte'?vaX'"3^t^.    The  differences  were 
not  found  to  be  significant  at  the  .05  level. 
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TABLE  2. — Comparison  of  Matched  Groups  on  Control  Variables 

Using  V/ilcoxon  Rank  Sum  Test 


Mean 


Median 


Range 


Dogmatism 
Score 
Group  A 
Group  B 


127.1 
125.8 


N»«8    M*««8    W»**69.5  Sig: 


NS 


Previous  Group 
Experience 
Group  A 


Group  B 


Extensive  work 
in  groups  and 
no  previous 
group  process 
training 


Extensive  work 
in  groups  and 
no  previous 
group  process 
training 


119 
117 


90--180 
86^178 


Minimal  previous  work 
in  groups  and  no  pre- 
vious group  process 
training — Extensive 
experience  in  working 
with  groups  and  20 
graduate  hours  in 
group  counseling  and 
sensitivity  training 
both  as  a  member  and 
trainer 

Minimal  previous  work 
in  groups  and  no  pre- 
vious group  Drocess 
training — Extensive 
experic  ice  in  working 
with  groups  c  'i  exten- 
sive participi  ion  in 
group  process  training 
over  a  three  year  period 


Pre--Test  Score 
Group  A 
Group  B 


59.5 
53-0 


N«:=8    M»*=8    \i^^^^72.5    Sig:  NS 


61.5 
57.5 


35-69 
18-69 


-  Number  of  individual  scores  in  Group  A. 
M**  -  Number  of  individual  scores  in  Group  B, 
W***  -  Rank  Sum  of  Group  A. 
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Through  the  procedure  described  above  the  experi- 
menter attempted  to  control  for  those  factors  identified  in 
the  research  literature  which  influence  eroup  effectiveness 
other  than  those  that  v;ould  be  explicitly  treated.  The 
pre-testing  procedures  ensured  that  both  groups  were  similar 
in  composf.tion.    Each  v;as  composed  of  the  same  number  of 
members — eight.    Each  group  worked  on  identical  problems. 
Both  were  newly  organized  such  that  the  status  hierarchy, 
amount  of  cohesiveness,  and  the  communication  network  were 
similar  at  the  beginning  of  the  study.    Since  both  groups 
were  composed  of  graduate  students  working  for  a  course 
grade 5  the  motivation  to  perform  the  tasks  was  assumed  to 
be  equal. 

Treatment 

The  experimental  group  received  group  process  training 
from  a  qualified  and  experienced  trainer.  Dr.  Robert 
Stakenas.    He  is  an  Associate  Professor  in  the  Department 
of  Educational  Research  and  Testing  at  Florida  State  Uni- 
versity.   Twelve  hours  of  training  was  given  to  the  experi- 
mental group  over  a  two-day  period  prior  to  their  beginning 
work  on  the  solutions  to  the  problems  involved  in  "Micro- 
ville."    To  begin,  each  member  was  asked  to  take  a  forty 
item  self-rating  scale  in  order  to  help  him  assess  his 
entering  skills  as  a  group  member.    This  exercise,  as  well 
as  the  other  training  exercises  used  by  Stakenas  during  the 
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twelve  hours  of  group  process  training,  can  be  found  in 
Appendix  B.    After  everyone  had  completed  the  scale, 
Stakenas  discussed  with  the  group  the  ob'Jectives  of  group 
process  training.    These  were  to  learn:     (1)  how  to  become 
a  more  effective  group  member;  (2)  how  to  communicate 
effectively  with  others;  (3)  group  p.-^oblem-solving  skills; 
{k)  how  to  help  the  group  make  decisions;  (5)  the  needs  of 
vourself  in  relation  to  those  of  the  group  and  (6)  how  you 
relate  to  authority  figures.    The  Self-rating  Scale,  he 
said,  contained  the  operationalization  of  the  training 
objectives.    The  basic  groundrule  of  keeping  the  discussion 
in  the  "here  and  now"  rather  than  in  the  "then  and  there" 
was  explained.    The  pesfc  of  the  three  hour  first  session 
was  turned  over  to  the  group  who  were  forced  by  the  trainer's 
silence  to  evolve  their  ovm  discussion  topics.    When  the 
group  really  got  "hung  up"  or  needed  some  interpretation 
of  the  process  as  it  was  evolving,  Stakenas  would  intervene. 

The  second  training  session  was  begun  by  again  taking 
the  Self-rating  Scale.    The  rest  of  the  session  revolved 
around  how  to  communicate  more  effectively  with  each  other. 

A 

Topics  such  as  non-verbal  cues,  accurate  message  sending 
and  receiving,  and  how  one  relates  to  authority  figures 
were  dealt  with  by  the  group.    Also  touched  upon  by  the 
group  v/as  the  question  of  v/hether  the  training  they  were 
getting  could  be  transferred  to  the  course  v;ork  in  ADT 
5^8.    Periodically,  Dr.  Stakenas  v/ould  ask  the  group  to 
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assess  its  own  progress  and  thus  help  them  become  more  aware 
of  the  process  they  v/ere  undergoing* 

At  the  beginning  of  the  third  training  session  each 
individual  received  a  one-page  summation  of  rules  developed 
by  Jay  Hall  designed  to  facilitate  group  consensus  and 
entitled,  "Group-Decision  Instructions"  (1971,  P*  5^)* 
After  each  group  member  had  read  the  handout,  copies  of 
three  suggested  group  tasks  v/ere  given  to  each  member  with 
explicit  directions  on  how  the  group  was  to  proceed  in 
selecting  a  task  to  be  dealt  with  by  the  group*    As  the 
group  worked  through  their  selected  task,  Stakenas  assumed 
the  role  of  "intervener"  when  the  previous  group  process 
training  v/as  not  being  utilized  by  the  group.    Thus,  the 
training  was  made  more  explicit  to  the  task.    The  entire 
six  hours  of  the  second  day's  session  was  devoted  to  the 
group's  working  through  their  selected  tasks  with  appropriate 
process  intervention  by  ota^cenas. 

The  extent  to  v/hich  the  -group  was  able  to  utilize 
the  group  process  training  in  the  process  of  solving  the 
problems  of  "Microville"  was  a-^certained  by  tv/o  raters 
using  Jahns'  Performance  Rating  Instrument.    More  detail 
on  this  instrument  is  given  in  the  next  section. 

Both  the  experimental  and  control  group  received 
the  same  instruction  with  regard  to  program  development 
principles.    Both  v/ere  given  the  same  amount  of  time  in 
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which  to  produce  a  written  sroup  product  for  each  phase  of 
program  development  which  required  it* 

Instrumenta./ion 
Data  on  the  three  major  experimental  variables, 
quality  of  group  process,  quality  of  the' group  products, 
group  cohesiveness,  and  gain  in  individual  achievement  were 
collected  by  means  of  (1)  Jahns*  Performance  Rating  Instru- 
ment, (2)  Group  Product  Evaluation  Rating  Scales,  (3)  Uni- 
versity of  Oklahoma  Group  Cohesiveness  Scale  and  (k)  Post- 
Test  of  Program  Development,  respectively.    The  properties 
of  these  instruments  are  discussed  in  this  section*  Copies 
of  these  four  instruments  are  found  in  Appendices-  C,  D,  E, 
and  P,  respectively. 

Jahns*  Performance  Rating  Instrument 

The  actual  analysis  of  the  quality  of  group  inter-  . 
action  of  the  experimental  and  control  groups  was  made  by 
using  a  group  rating  instrument  developed  by  Dr.  Ir^^in 
Jahns  (1961).    In  devising  this  instrument  Jahns  made  a 
careful  study  of  group  dynamics  literature  concerned  with 
interaction  analysis.    He  concluded  from  this  survey  that 
two  fundamental  rating  systems  have  been  developed  by  social 
psychologists  to  study  the  characteristics  of  groups.  In 
the  first  system  the  rater  attempts  to  place  the  individuals 
being  studied  along  a  scale  to  represent  the  extent  to 
which  they  exhibit  behavioral  characteristics  such  as 
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dependability,  cooperativeness  and  leadership.    This  system, 
however,  is  faulted  by  Jahns  in  that  all  tpo  often  the 
rater  does  not  have  sufficient  information  to  make  the 
rating;  and  the*  inter-rater  reliability  of  the  instrument 
is  disappointly  lov/.    Jahns  further  reports  that  in  an 
effort  to  overcome  the  limitations  possessed  by  the  first 
system,  psychologists  have  turned  increasingly  to  the 
minute  categorization  of  small  behavior  units.    This  system 
appeared  to  Jahns  to  be  more  satisfactory  than  the  first 
in  suggesting  reliable  methods  of  measuring  the  quality 
and  quantity  of  a  group's  interaction  (Jahns,  196l,  pp.  21-22) 
On  the  basis  of  these  observations,  Jahns  drew  heavily  on 
Benne  and  .Sheats  (1948,  pp.  ^1-^9)  to  establish  his  perform- 
ance rating  instrument.    However,  after  testing  the  instrument 
Jahns  prepared  the  revised  list       performance  categories 
as  illustrated  in  Table  3  (196l,  p.  37).     It  was  this  revised 
instrument  that  was  utilized  in  this  study. 

As  can  be  seen  by  looking  at  Table  3,  Jahns'  instru- 
ment utilizes  three  performance  categories:     (1)  Task 
oriented;  (2)  Group  oriented;  and  (3)  Self-oriented. 
Contributions'  under  the  task  oriented  category  are  related 
to  the  task  which  the  group  is  deciding  to  undertake  or 
has  undertaken.    Their  purpose  is  to  facilitate  and  coordi- 
nate group  effort  in  the  selection  and  definition  of  a 
common  problem  and  in  the  solution  of  that  problem.  The 
group-oriented  classification  involves  those  contributions 
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TABLE  3. — Performance  Categories  for  Classification  of 

Member. Contributions 


Task  Oriented 


.  Group  Oriented       Self-Orient  3d 


1.  Gives  suggestion  or 
direction 

2.  Gives  information 
or  opinion 

3.  Seeks  information  or 
opinion 

Seeks  suggestion 
or  direction 

5.  Repeats,  clarifies, 
restates 


6.  Orients 

7.  Summarizes 


r.  Greets 

2.  Kids 

3.  Compromises 
^.  Harmonizes 
5.  Encourages 


1.  Wonders 


2.  Propogates 
wondering 

3.  Seeks 
sympathy 

^.  Attacks 


5.  Defends  self 
(and  self 
sympathy) 


6.  Plays 


which  aid  in  the  functioning  of  the  group  as-  a  group. 
The  self-oriented  category  includes  those  contributions 
which  are  directed  toward  the  satisfaction  of  the  group 
member's  individual  needs.    Their  purpose  is  to  satisfy 
some  individual  goal  which  is  relevant  neither  to  the 
group  task  nor  to  the  functioning  6f  the  group  as  a  group. 
To  aid  in  the  rating  of  contributions  Jahns  further  analyzed 
these  categories  into  sub^classiflcations  as  had  been  pre- 
viously suggested  by  Benne  and  Sheats.    These  are  listed 
in  Table  3.    A  f ui^tJ^  di^ 
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sub-classiflcatlprrs"^can  be  found  in  Benne  and  Sheats 

Johns'  category  system  was  chosen  over  Bales'  Inter- 
action Process  Analysis  because  it  was  felt  by  this  investi- 
gator that  Jahns '  instrument  v/as  more  directly  relevant  to 
the  hypotiieses  under  investigation  in  this  study.  It 
offered  the  additional  advantage  of  a  less  complex  categoiy 
system  which  made  training  of  the  raters  an  easier  process. 
In  addition,  the  fact  that  Jahns  was  available  to  counsel 
the  writer  in  the  use  of  his  instrument  offered  incalculable 
benefits. 

Jahns'  instrument  was  slightly  modified  by  this  writer 
to  include  space  for  the  v/ritten  transcription  of  the  inter- 
action of  the  groups  under  investigation.    Each  rater  used 
both  the  written  transcription  of  each  group  session  and 
the  sound  recording  to  rate  each  member's  contribution.  A 
contribution  was  considered  as  a  simple  sentence  which 
conveyed  a  complete  thought.     V/hen  a  sentence  v/as  complex 
a  separate  score  was  given  each  of  its  component  simple 
parts;    Each  such  contribution  was  placed  in  one  of  the 
three  listed  categories  according  to  its  nature  and 
'orientation. 

Group  Product  Evaluation  Scales 

The  Group  Product  Evaluation  Scoles  were  developed 
for  the  study  in  order  to  measure  the  quality  of  each 


Council products.    The  criteria  uSed  to  measure  each 
product *s  quality  were  derived  from  a  content  analysis  this 
researcher  had  made  of  all  products  developed  by  previous 
Councils  engaged  in  ADT  5^8.    Rating  scales  v/ere  then 
developed  for  each  product  using  these  criteria.  These 
rating  scales  were  subjected  to  further  scrutinization 
by  two  professors  of  the  Department  of  Adult  Education  at 
Florida  State  University.    Revisions  v/ere  made  based  on 
their  feedback  to  the  end  of  removing  any  ambiguities  or 
misunderstanding  in  the  wording  of  each  criterion.  This 
process  was  especially  useful  in  that  the  two  aforementioned 
professors  also  served  as  the  group  product  judges. 


developed  by  the  University  of  Oklahoma  to  measure  group 
cohesiveness  which  is  reflected  in  such  things  as  member 
satisfaction  with  the  group,  resistance  to  leaving  the 
group,  and  other  positive  reactions  to  the  group  (Shaw, 
1971).    It  consists  of  six  questions  and  for  each  the  sub- 
ject is  asked  to  circle  one  of  nine  points  ranging  from 
very  positive  to  extremely  negative  v/ith  the  fifth  point 
being  neutral.    This  rating  scale  hatt  been  used  by  the 
staff  at  the  University  of  Oklahoma  in  connection  with 
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sions  of  the  Group  Product  Evalua- 


University  of  Oklahoma  Group 
Cohesiveness  Scale 


The  Group  Cohesiveness  Scale  was  adapted  from  one 


Phaoe  II3  "Human  Relations  and  Communications"  Seminar  of 
its  Rehabilitation  Services  Administration  Management 
Training  Program  since  July^  I965.    James  A,  West,  Coordina- 
tor of  the  RSA  Management  Trainir*^;  Program,  reports  that 
although  no  specific  figures  are  available  this  instrument 
has  been  found  to  have  high  reliability  and  validity  over 
the  aeven  years  it  has  been  used  rt  the  University  of 
Oklahoma. 

Pos't-test  of  program  development 

A  post-test  of  program- development  involved  in  the 
content  of  the  course  v/as  used  to  measure  individual  gain  in 
achievement.     This  test  contained  items  which  were  essen- 
tially the  same  as  those  on  the  pre-test.    The  items  on 
this  test  had  been  administered  to  a  previous  ADT  5^8 
class  and  found  to  be  a  valid  measure  of  the  content  of  the 
course.     Individual  gain  in  achievement  v/as  ascertained  by 
subtracting  the  score  each  subject  had  made  on  the  pre-test 
from, that  which  was  made  post-test. 

Data  Collection* 
The  procedures  involved  in  this  study  will  be  dis- 
cussed under  four  sub-headings:     (l)  General  Procedures; 
(2)  Group  Process  Data;  (3)  Group  Product  Ratings;  and 
(^)  Administration  of  Post-Instruments. 
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General  procedures 

The  entire  experiment  ran  for  an  eleven  week:  duration 
from  the  first  class  meeting  of  ADT  5^8  to  the  last  session 
during  which  the  post-test  instruments  v;ere  administered •  . 
In  detail,  both  the  trained  and  untrained  groups  met 
-^together  for  instruc-tion  and  directions  on  how  to  proceed 
with  the  assigned  task.    During  the  joint  Council  meetings, 
copies  of  the  criteria  by  which  each  group »s  product  would 
be  evaluated  were  given  to  each  member.    Then  each  group 

moved  to  separate  locations  to  come  up  with  solutions  in  the 

\ 

form  of  a  group  product  to  the  problems  involved  in  the 

i 

Simulation  game,  "Microville . "    Each  Council  was  allowed  to 
meet  only  during^ the  regularly  scheduled  class  meeting  time 
to  assure  uniformity  of  conditions  under  which  the  products 
were  produced.    Due  to  the  differing    nature  of  the  required 
products,  differential  amounts  of  time  were  given  to  com- 
plete them.    Each  Council  had  two  class  meetings  to  come  up 
with  the  philosophy-^policy  product;  one  for  devising  of  a 
strategy  to  identify  Mcroville^s  needs  and  wants;  three 
class  sessions  for  the  determination  of  needs  and  wants  and 
for  the  development  of  a  criterion  system  for  assigning 
priorities  for  these  needs  and  wants;  one  session  for 
developing  community-level  objectives  and  one  session  for 
analyzing  a  community-level  objective.    At  each  group  session 
an  observer  was  present  in  the  person  of  either  the  instructor 
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or  this  researcher  v/ho  alternated  with  each  group.  The 
observer's  role  was  limited  to  ansv/ering  f>rocedural  questions 
Since  he  took  no  active  role  in  the  discussion,  he  was  not 
counted  as  a  member.    Although  all  group  meetings  v/ere 
recorded  with  the  knowledge  of  thn  participants,  the  pur- 
pose of  the  study  was  screened  from  them. 

Group  process  data 

Tne  study  of  the  group  processes  of  the  control  and 

♦ 

experimental  groups  v/as  based  on  the  written  transcriptions 
prepared  from  the  tape  recordings  of  the  group  meetings  and 
the  tape  recordings  themselves.    The  reliability  of  using 
tape  recordings  and  transcripts  for  studying  small  group 
interaction  was  investigated  by  Ross  (I960).    He  concluded 
that  the  use  of  tape  recordings  and  transcriptions  are 
equally  as  reliable  as  data  based  on  the  direct  observations 
of  groups.    The  quality  of  each  group ^s  interaction  was 
analyzed  ^y  two  raters  using  Jahns*  Performance  Rating 
Instrument . 

The  raters  were  chosen  because  of  their  previous 
experience,  in  rating  group  process  and  because  of  their 
extensive  course  work  in  the  area  of  group  dynamics.  Prior 
to  their  rating  of  experimental  data,  this  experimenter 
introduced  both  raters  to  Jahns*  Instrument  and  familiarized 
them  with  his  category  system.    Then  each  was  given  a  dupli- 
cate recording  and  transcription  of  one  of  the  group 


training  sessions  durin.  which  the,  sroup  was  worKine 
on  an  assigned  taslc  and  ao.ed  to  analyze  the  interaction. 
«ot  only  did  this  ser.e  to  further  ovient  the  raters  to 
Jahns.  instrument  but  also  to  the  voices  on  the  cassette 
recording.    This  was  followed  up  by  a  two  hour  discussion  of 
the  reasons  each  had  rated  the  interactions  as  he  did.  This 
was  an  attempt  to  .a.ce  the  guidelines  of  each  category  clearer. 
Each  was  then  given  another  recording  and  transcription  of 
another  portion  of  the  training  session.    After  each  had 
returned  his  rating  to  this  researcher,  another  training 
meeting  was  held  to  discuss  the  discrepancies  in  the  ratings 
and  to  reach  consensus  on  the  ratings. 

Following  this  initial  rater  training  period,  which 
was  approxi,nately  eight  hours  in  length,  each  rater  was 
given  duplicate  cassette  tapes  and  written  transcriptions 
of  the  first  council  meetings  of  the  experimental  and  con- 

wv,»n  both  had  returned  their  individual 
trol  groups*    Vmen  r>ozn  nau 

ratings,  another  meeting  was  held  to  go  over  with  each  rater 
Where  their  ratings  differed  and  to  reach  consensus  on  them, 
^is  meeting  actually  served  as  another  training  session  as 
„ore  definitive  guidelines  between  categories  were  worKed 
out.    At  the  conclusion  of  this  session,  duplicate  recordings 
and  transcriptions  of  the  second  Council  meeting  of  both 
groups  were  given  to  the  raters  to  be  analyzed.    The  above 
procedure  was  the  one  followed  for  all  subsequent  data 
involving  group  interaction.    After  collection  of  the  data 
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was  completed  and  consensus  had  been  achieved  on  all  ratings, 
the  number  oi  contributions  in  each  categoiy  was  tallied  for 
each  individual  for  the  eight  sessions  in  v/hioh  he  partici- 
pated and  for  each  group  as  a  v/hole*    These  results  as 
analyzed  can  be  found  in  the  next  chapter 

Group  product  ratings 

Two  professors  of  Adult  Education  at  Florida  State 
University  v/ere  selected  to  assess  the  quality  of  the  group 
products  developed  by  the  control  and  experimental  groups. 
Prior  to  their  rating  the  groups*  products  involved  in  the 
research,  each  was  given  a  group  product  developed  by  a 
Council  in  a  previous  ADT  5^<8  class  with  its  appropriate 
evaluation  scale.-  The  ratings  were  compared  in  a  meeting 
with  the  experimenter  and  the  two  judges.    These  meetings 
served  two  purposes:     (1)  Assumptions  that  each  judge  was 
making  about  each  of  the  criteria  were  made  explicit;  and 
(2)  This  experimenter  received  input  as  to  how  the  evalua- 
tion scale  developed  for  each  product  might  be  improved. 

Subsequent  to  the  above  meeting,  each  Judge  was 
given  a  copy. of  the  experimental  and  the  control  group's 
products  along  with  the  revised  evaluation  sheet  for  each. 
Each  judge  evaluated  the  products  separately  and  then  met 
with  the  researcher  to  arrive. at  consensus  on  their  ratings 
of  product  quality.    This  was  the  procedure  followed  for 
each  of  the  five  group  products.    In  each  case,  consensus 
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on  the  product  ratings  v/as  achieved.    The  results  of  the 
analysis  of  these  data  will  be  found  in  the  next  chapter. 

4 

Administration  'of  post  Instrument;? 

The  last  class  session  of  ADT  5^8  was  spent  exclusively 
in  the  process  of  administering  t})c  University  of  Oklahoma 
Group  Coheslveness  Scale  and  the  J*ost-Test  of  Program  Devel- 
opment and  Evaluation  to  members  of  both  the  experimental 
and  control  groups  •    The  Group  Coheslveness  Scale  v/as 
administered  first  so  as  to  prevent  Its  results  from  being 
contaminated  by  the  possible  anxiety  that  might  be  aroused 
by  the  post-test •    The  results  of  the  analysis  of  these  data 
can  be  found  In  the  next  chapter. 


CHAPTER  V 


ANALYSIS  OP  DATA 


This  chapter  discusse^s  th3  operations  which  trans- 
formed the  raw  data  into  a  form  which  meaningfully  addressed 
the  research  hypotheses  of  this  study.    It  should  be  noted 
that  the  minimum  level  of  significance  considered  for  this 
study  was  ,05. 


**  Research  Hypotheses  Testing 
A  main  concern  of  this  study  was  to  determine  whether 
group  process  training  had  any  effect  on  the  quality  of 
group  interaction.    This  concern  was  observed  in  hypotheses 
1,  2  and  3. 

1.    A  grpup  v/hich  has    eceived  group  process  training 
will  evidence  a  s-gniflcantly  greater  distribution 
of  participation  among  its  members  than  a  group 
which  has  not  received  group  process  training. 

2#    A  group  which  has  received  group  process  training 
will  make  a  significantly  smaller  percentage  of 
self-oriented  contributions  than  will  a  group  v/hich 
has  not  received  group  process  training. 

3.    A  group  v;hich  has  received  group  process  training 
will  make  a  significantly  higher  percentage  of 
group-oriented  contributions  than  will  a  group 
which  has  not  received  group  process  training. 

Hypotheses  1,  2  and  3  were  tested  as  follov/s:  The 

responses  made  by  each  individual  in  each  group  session  were 

-    ki  * 


categorized  by  the  trained  raters  as  either  task,  group  or 
self-oriented.    These  categorized  responses  were  totaled  by 
individual  and  by  group  for  each  session*    Hypothesis  1  v/as 
concerned  v/ith  whether  the  trained  group  would  evidence  a 
more  even  distribution  of  its  memoer  contributions  over  the 
group  sessions  than  v/ould  an  untrained  group*     In  other 
v/ords,  would  the  trained  group  members'  contributions  sh 
less  variance  than  v;ould  those  of  the  untrained  group?  This 
hypothesis  was  tested  by  first  ta?.lying  the  number  of  con- 
tributions over  all  three  categories  for  each  individual  for 
the  eight  sessions  in  which  he  participated*     If  a  subject 
did  not  attend  one  of  the  meetings,  his  score  was  corrected 
for  the  eight  sessions  by  determining  his  characteristic 
interaction  rate -in  each  category  and  adding  this  to  his 
total  category  scores.    The  characteristic  interaction  rate 
is  defined  as  the  number  of  acts  3n  each  category  omitted  by 
an  individual  over  a  specific  period  of  time.    According  to 
Borgatta  and  Bales,  each  group  member  can  be  regarded  as 
having  a  characteristic  rate  of  interaction  which  is  an 
inverse  function  of  the  characteristic  rates  of  his  co-members 
(1953,  P*  302).    To  test  for  the  significance  of  the  differ- 
ence  between  two  variances  of  the  r.ieraber  contributions  of 
the  trained  and  untrained  groups,  the  P-test  was  utilized. 
The  P-test  v/as  appropriate  because  we  are  testing  variances 
of  two  independent  samples  of  scores  which  can  be  assumed  to 
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have  approximately  normal  distribution.     According  to 
Ferguson  (I966,  pp.  16^-166)  the  significance  of  the 
difference  betv/een  tv/o  variances  may  be  determined  by: 


S  2 

p  =      B                    .  a  -  number  of  members  In 

^A^  Group  A 

(^A.2)-aA^  A.=  'Scor<j  for  members  in 

S^2  =  IziJ:   ^    Group  A 


a  -  1 


b  =  number  of  members  in 
Group  B 


.  _2        B.=  score  for  members  in 

(£  B  2  )  -  b  B  ^  Group 

1=1      •  .  • 

b  T-  1  . 

The  results  of  the  P-Test  appear  in  Table 


TABLE      — Comparison  of  the  Dispersion  of  Contributions 
between  Trained  and  Untrained  Groups  by  Session  and  Total 

Using  F-Test 


Trained  Untrained 

Group 

Session         S^2  Sg2  F         df         Sig.  Direction 

Number 


1  .  583.^9  5753. 6i< 

2  6620.29  12692.29 

3  .3709.1'!  8229.86 
l|  3588.81  '17215.81 

5  2263.98  61058.58 

6  20i<0.56  13101.19 

7  3512.33  5'<95.33 

8  71'<8.07  27'<'<1.65 

Total  68866.04  518802.32 


9 

.86 

(7,6) 

p<.01 

A<B 

1 

.92 

(7,7) 

NS 

A<B 

2 

.22 

(7,6) 

NS 

ACB 

13 

.16 

(7,6) 

p<.01 

A<B 

26 

.97 

(5,6) 

p<.01 

A<B 

6 

.h2 

(7,6) 

P<.05 

A<B 

1 

.56 

(.7,6) 

NS 

A<B 

3 

.8H 

(7,5) 

p<.10 

A<B 

7 

.53 

C7,7) 

p<.01 

A<B 

^Absentee  members  scores  adjusted  to  be  equivalent 
to  an  8  session  total. 
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An  inspection  of  Table  ^  shows  that"  for  each  of  the 
eight  group  sessions,  the  variance  in  the  dispersion  of 
contributions  v/as  less  for  the  Trained  Group.     However  thr 
differences  were  non-significant  at  the  .05  level  for  four 
of  the  sessions.     In  looking  at  the  eight-  sessions  as  a 
whole  and  when  the  absentee  members  responses  v/ere  adjusted 
to  be  equivalent  to  an  eight-sess:\on  total,  as  described 
above,  the  differences  between  the  variances  in  the  contri- 
butions- of  the  trained  and  untrained  groups  was  significant 
at  the  .01  level.    Thus,  hypothesis  1  was  supported  by  the 
data* 

Hypothesis  2  was  ?.oncerned  with  whether  the  trained 
group  would  make  fewer  self-oriented  responses  than  would 
the  untrained  group.    Hypothesis  2  was  tested  as  follows: 
The  number  of  self-oriehted  contributions  was  tallied  for 
each  individual  for  each  of  the  eight  sessions  in  v/hich  he 
participated.    Then  the  individual  responres  in  this  cate- 
gory were  summed  for  each  of  the  sessions  to  get  a  group 
total.     Since  the  total  number  of  contributions  was  not 
equal-  in  both  groups  due  to  a  number  of  factors  including 
differential  amounts  of  time  for  coffee  breaks,  the  raw 
scores  per  session  of  each,  group  were  converted  to  per*^ 
centages.    These  percentages  were  ranked  and  the  rank  sums 
for  the  groups  were  analyzed  for  significant  difference 
using  the  Wilcoxon  Rank  Sum  Test.    This  test  was  selected 
since  it  was  appropriate  for  analysis  concerned  with 
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comparing  tv;o  independent  samples  of  non-normal  data 
(Wilcoxon  and  \7ilcox,  196^,  p,  78).    The  results  of  this 
analysis  appear  in  Table  5« 


TABLE  5. — Comparison  of  Trained  and  Untrained  Groups  on 
Self-Oriented  Contributions  Using  V/ilcoxon  Rank  Sum  Test 


Group  Session 
Number 

Percentage  of  Self 

-Oriented  Contributions 

Tralned(A) 

Untrained(B) 

1  ' 

0 

2 

1.08 

3.12 

3 

.22 

i^ 

.65 

3.96 

5 

0 

8.93 

6 

.91- 

5.33 

7 

0 

3.73 

8 

0 

7.13 

N«=8    M««=:8  V/*** 

=  36    Sig:     p<.005  ' 

Direction  A<B 

N*  -  Number  of  Sessions  for  Group  A 
M**  -  Number  of  Sessions  for  Group  B 
W***  -  Rank  Sum  for  Group  A 


An  inspection  of  the  data  in  Table  5  indicates  that 
for  every  session,  the  trained  group  made  a  smaller  percent- 
age of  self-oriented  contributions  and  that  over  the  eight 
group  sessions,  this  difference  was  significant  at  the 
.005  level. 

Hypothesis  3  v/as  concerned  with  whether  the  trained 
group  would  make  a  higher  percentage  of  group-oriented 
contributions  than  would  an  untrained  group.    This  hypothesis 
v/as  tested  as  follows.'   The  number  of  group-oriented 
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responses  was  totaled  by  individual  and  by  group  for  each 
session.    These  per  session  rav/  scores  of  each  group  v/ere 
then  converted  into  percentages  for  the  'reason  noted 
above.    Tnese  percentages  for  both  the  trained  and  untrained 
groups  v;ere  ranked  and  the  rank  sums  analyzed  for  signifi- 
cance.   Bocause  of  the  nature  of  the  data,  the  V/ilcoxon 
Rank  Sum  Test  was  again  used  for  this  purpose.     The  findings 
are  presented  in  Table  6. 

TABLE  6 1 — Comparison  of  Trained  and  Untrained  Groups  on 
Group-Oriented  Contributions  Using  Wllcoxon  Rank  Sum  Test  • 


Percentage  of  Group-Oriented  Contributions 


Group  Session   

Number  Trained(A)  Untrained(B) 


1  •  36.7  16.1 

2  3^.1  20.8 

3  31.7  23.1 
H  30.2  18. i| 

5  2H.5  l8.il 

6  31.1  18.9 

7  '  2^.8  18.0 

8  30.3  26.5 


N*=:8    m^^B    w^'**^=93    Sig:    p<.005    Direction  A>B 


N'^  -  Number  of  Sessions  for  Group  A 
M^if  «  Number  of  Sessions  for  Group  B 
W**»  -  Rank  Sum  for  Group  A 


An  inspection  of  the  data  in  Table  6  indicates 
that  for  every  session,  the  trained  group  ma(ie  a  higher 
percentage  of  group-oriented  contributions;  and  that  over 
the  eight  group  sessions,  this  difference  was  significant 
at  the  .005  level.    Thus  hypothesis  3  was  confirmed. 
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Another  main  concern  of  this  study  was  whether  the 
quality  of  the  solutions  to  problems  as  evidenced  In  the 
group  products  developed  by  the  trained  group  would  be 
significantly  higher  than  those  developed  by  the  untrained 
group.    This  concern  was  addressed  in  hypotheses  ^,  5,  6/ 
7,  and  8. 

^.    A  group  which  has  received  group  process  training 
will  product  a  significantly  higher  quality 

Philosophy-Policy"  product  than  will  a  group  which 
has  not  received  group  process  training. 

5.  '  A  group  which  has  received  group  process  training 

will  produce  a  significantly  higher  quality 
"Strategy"  product  than  will  a  group  which  has 
not  received  group  process  training. 

6.  A  group  which  has  received  group  process  training 
v;ill  produce  a  significantly  higher  quality 
"Criterion  System"  product  than  will  a  group 
'Which  has  not  received  group  process  training. 

7.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Community-Level  Objectives"  product  than  will 

a  group  v;bich  has  not  received  group  process 
training. 

8.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 

Analysis  of  a  Community-Level  Objective"  product 
than  will  a  group  which  has  not  received  group 
process  training. 

These  hypotheses  were  tested  by  analyzing  the  data 
obtained  from  the  consensus  scores  of  the  twp  judges  for 
each  of  five  products  developed  by  the  trained  and  untrained 
groups.    Utilizing  the  above  scores  on  each  of  the  products, 
inter-group  analyses  were  computed  for  the  trained  and 
untrained  groups  to  check  for  differences  between  the 
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quality  of  the  products.  These  differences  were  analyzed 
for  significance  using  the  Wilcoxon  Matched  Pairs  Signed- 
Ranks  Test.  This  test  was  selected  since  it  was  appropriate 
for  analysis  concerned  v;ith  comparing  tv;o  related  samples 
yielding  difference  scores  which  can  be  ranked  in  order 
of  absolute  magnitude  (Siegel,  1965,  p.  78).  The  results 
of  this  analysis  appear  in  Table  7. 


TABLE  7. — Comparison  of  Quality  of  Group  Products  between 
Trained,  and  Untrained  Groups  Using  V/ilcoxon  Matched  Pairs 

Signed-Ranks  Test 


Product 

N» 

M*» 

T" 

T+ 

Sig 

Direction 

Philosophy- 
Policy 

16 

11 

25 

^10.5 

NS 

Strategy 

7 

6 

0 

21 

PV025 

A7B 

Criterion 
System 

12 

12 

0 

78 

P<.005 

A>B 

Community— 
Level 

Objectives 

11 

11 

0 

66 

P<.005 

A7D 

Analysis  of 
Community- 
Level 

Objectives 

12  . 

11 

12 

5^4 

p<.05 

A>B 

-  Number  of  questions 

'M**  ^  Number  of  nonzero  questions 

T"'  -  Sum  of  Ranks  of  Negative  Differences  betv/een 
Criterion  Scores 

T***  -  Sum  of  Ranks  of  Positive  Differences  between. 
Criterion  Scores 
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An  inspection  of  Table  7  Indicates  that  for  each  of 
the  group  products,  the  difference  v^as  in  the  direction 
hypothesized.     In  the  case  of  the  philosophy-policy  product, 
the  difference  was  not  significant.    However,  for  the  four 
other  group  products,  the  trainad  group  produced  a  higher 
quality  product  than  the  untrained  group.     The  differences 
v/ere  significant  at  levels  ranging  from  .05  to  .005*  Thus, 
although  hypothesis  4  was  not  confirmed;  5,  6,  7,  and  8 
were  supJported  by  the  data* 

Another  concern  in  this  investigation  v/as  to  deter- 
mine whether  the  trained  group  would  evidence  significantly 
greater  group  cohesiveness  than  would  the  untrained  group. 
This  concern  was  addressed  in  research  hypothesis  9. 

9.     A  group  which  has  received  group  process  training 
will  evidtsnce  significantly  greater  group  cohe- 
siveness than  a  group  which  has  not  received 
group  process  training. 

This  was  tested  by  analyzing  the  data  obtained  from 
the  University  of  Oklahoma  Group  Cohesiveness  Scale  v;hich 
had  been  administered  to  both  groups.    Each  member's  score 
was  computed  by  summing  his  individual  numbered  response 
to  each  of  the  seven  questions  on  the  Group  Cohesiveness 
Scale*    These  scores  for  each  member  in  the  trained  and 
untrained  groups  were  than  ranked  and  their  rank  analyzed 
for  significant  difference  using  the  Wilcoxon  Rank  Sum 
Test*    The  results  of  this  test  appear  in  Table  8. 
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TABLE  8. — Comparison  of  Trained  and  Untrained  Groups  on 
Group  Cohesiveness  Using  V/ilcoxon  Rank  Sum  Test 


Scores  on  Group  Cohesiveness  Scale 


Member  Number  .    Trained(A)  Untrained(B) 

1  48  34 

2  35  31 

3  46  30 

4  47  ^2 

5  44  40 

6  44  47 

7  •  ?5  ?3 
8*  47  47 

N»=8    M«»=8  W»**=85    Sig:    p  .05  Direction    A  B 


N*  -  Number  of  Individual  Scores  in  Group  A 
M**  -  Number  of  Individual  Scores  in  Group  B 
W««5f  _  Ranlc  Sum  for  Group  A 

An  inspection  of  Table  8  reveals  that  the  mean  rank 
of  the  scores  of  the  trained  group  is  significantly  higher 
than  that  of  the  untrained  group  at  the  .05  level.  Thus, 
hypothesis  9  was  confirmed. 

Still  another  concern  of  this  study  was  in  the  com- 
parison of  the  gain  in  achievement  in  course  content  between 
individuals  in  the  trained  group  and  those  in  the  untrained 
group.    This  concern  was  expressed  in  hypothesis  10. 

10.    "individuals  in  a  group  which  received  group 
process  training  will  exhibit  significantly 
greater  gains  in  achievement  in  course  content 
than  will  individuals  in  a  group  which  has  not 
receivod  sroup  process  training. 
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Hypothesis  10  was  tested  as  follov;s'.    Each  indivi- 
dual's score  on  the  Pre-Test  of  Course  Content  v;as  subtracted 
from  his  "score  on  the  Post-Test  to  determine  his  individual 
point  gain  aohievement.    These  "gain"  scores  were  ranked 
and  the  rank -sums  for  the  groups  analyzed 'for  significance 
utilizing  the  V/ilcoxon  Rank  Sum  Test.    The  results  of  this 
data  analysis  appear  in  Table  9- 


TABLE  9. — Comparison  of  Gain  in  Achievement  betv/een  Individuals 
in  a  Trained  Group  and  Individuals  in  an  Untrained  Group  Using 

Wilcoxon  Rank  Sum  Test 


Individual  Gain  in  Points  on  Post-Test  of 
Course  Content 


Member  Number 

Tralned(A) 

Untrained(B) 

1 

28 

9 

2 

17 

-1 

I 

10 

lH 

11 

3 

5 

13 

•  9 

6 

10 

11 

7 

5 

10 

8 

19 

19 

N«=8   M**=8  V/«*«=8l 

Sig;  NS 

N*      -  Number  of  "Gain"  Scores  in  Group  A 
M**    -  Number  of  "Gain"  Scores  in  Group  B 
-  Rank  Sum  for  Group  A 


An  inspection  of  Table  8  indicates  that  although 
the  mean  rank  of  the  difference  in  "gain"  scores  was  in  the 
direction  predicted,  the  difference  v/as  not  significant  at 
the  .05  level.    Thus,  hypothesis  10  v;as  not  confirmed. 


CHAPTER  VI 


SUMMARY,  CONCLUSIONS  AND  IMPLICATIONS 

The-  contents  of  this  chapter  are  presented  in 
three  sections:     (1)  Summary  of  the  Study,  (2)  Conclusions 
and  (3)  Implications. 

Summary  of  the  Study 
The  spllent  aspects  of  this  study  are  summarized 
as:    The  Study  and  Its  Objectives,  Theoretical  Considera- 
tions, Research  Procedures  and  Findings  of  the  Study. 

The  study  and  Its'  ob.jectlves 

In  recent  years  there  has  been  a  blugeoning  of 
research  studies  indicating  that  there  are  many  factors 
Involved  In  the  interaction  process  v;hlch  inhibit  the 
effectiveness  of  groups.    Research  findings  are  relatively 
clear  regarding  the  skills  which  must  be  performed  by 
group  members  if  a  group  is  to  utilize  all  the  resources 
available  to  it.    But  practical  experience  in  working  with 
groups  reveals  that  group  members  seldom  employ  skills 
even  remotely  resembling  those  suggested  by  research  as 
essential  in  maximizing  group  effectiveness.    Thus,  it 
appeared  reasonable  to  this  v/rlter  that  the  achievement 
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of  group  effectiveness  might  be  facilitated,  by  training  a 
group  in  the  task  and  group  maintenance  functions  that  must 
be  performed  if  a  group  is  to  be  optimally  productive. 
Many  studies  have  shown  the  efficacy  of  group  process 
training  in  bringing  about  personal  change  and  stimulating 
individual  gains  in  sensitivity,  open-mindedness ^  and  self- 
insight.    Few,  hov/ever,  have  been  conducted  indicating  what 
utility  these  changes  have  for  improving  the  problem  solving 
abilities  of  groups. 

Based  upon  previous  research,  then,  plus  considera- 
tions of  the  import  that  this  study  might  have  in  an  era 
where  groups  are  increasingly  being  called  upon  to  solve  the 
problems  of  our  time;  this  writer  determined  the  need  for 
research  aimed  at*  investigating  the  role  of  group  process 
training  in  maximizing  the  effectiveness  of  groups.  Conse- 
quently, this  study  focused  upon:    (1)  Comparing  the  quality 
of  interaction  of  a  group  which  had  received  group  process 
training  with  the  quality  of  interaction  of  a  group  v/hich 
had  not  received  the  training;  and  (2)  Comparing  the  quality 
of  solutions  to  problems  produced  by  a  group  which  had 
received  group  process  trainj.ng  with  those  produced  by  a 
group  which  had  not  received  the  training.    In  addition, 
the  study  was  designed  to  determine  whether  a  group  which 
had  received  training  in  group  processes  would  evidence 
greater  group  cohesiveness  than  would  a  group  which  had 
not  received  the  training.    Finally,  an  effort  was  made  to 
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determine  if  the  individuals  of  a  z^onp  vihich  had  received 
the  group  process  training  v/ould  make  higher  gains  in 
achievement  on  a  test  of  course  content  than  would  the 
individuals  in  a  group  which  had  not  received  the  training. 

The  following  research  hypotheses  were  used  to 
guide  and  direct  this  study: 

1.  A  group  which  has  received  group  process  training 
will  evidence  a  significantly  greater  distribution 
of  participation  among  its  members  than  a  group 
which  has  not  received  group  process  training. 

2.  *A  group  which  has  received  group  process  training 
will  make  a  significantly  smaller  percentage  of 
self-oriented  contributions  than  will  a  group 
v;hich  has  not  received  group  process  training. 

3.  A  group  which  has  received  group  process  training 
will  make  a  significantly  higher  percentage  of 
group  oriented  contributions  than  will  a  group 
which  h^s  not  received  group  process  training. 

A.    A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"philosophy-policy"  product  than  will  a  group 
which  has  not  received  group  process  training. 

5.  A  group  which  has  received  group  process  training 
V7ill  produce  a  significantly  higher  quality 
"Strategic product  than  will  a  group  v/hich  has 
not  received  group  process  training. 

6.  A  group  v/hich  has  received  group  process  training 
v;ill  produce  a  higher  quality  ^'Criterion  System" 
product  than  will  a  group  which  has  not  received 
group-  process  training.* 

7.  A  group  which  has  received  group  process  training 
will  produccf  a  significantly  higher  quality 
"Community -Level  Objectives"  product  than  will  a 
group  whic)\  has  not  received  group  process  training. 

8.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Analysis  of  a  Community-Level  Objective"  product 
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than  will  a  G^^oup  which  has  not  received  group 
process  training • 

9,    A  group  which  has  received  group  process  training 
will  evidence  significantly  greater  group  cohesive- 
ness  than  will  a  group  which  has  not  received 
group  process  training, 

10*  individuals  in  a. group  which  has  received  group 

process  training  will  exhibit  significantly  greater 
gains  in  achievement  in  course  content  than  v;ill 
individuals  in  a  group  whicn  has  not  received  group 
process  training* 

Theoretical  considerations 

The  theoretical  foundation  of  this  study  v;as  in  a 
social-psychological  theory  of  interaction  which  suggests 
that  the  interaction  process  contains  potentially  inhibiting 
factors  which  may  prevant  a  group  from  optimally  utilizing 
its  available  member  resources.    A  basic  assumption  of 
this  study  was  that  in  order  to  fully  comprehend  the  inter- 
action process,  it  would  be  necessary  to  explore  the  total 
psychological  field.    This  would  combine  knowledge  of  rela- 
tionships within  and  outsiae  of  groups,  plus  all  the 
cultiural,  socio-economic  and  psychological  forces  which 
impinge  upon  and  Influence  the  interaction  of  the  members 
of  a  group*    As  it  was  not  feasible  to  study  the  total 
psychological  field,  a  simple  theory  dealing  with  relatively 
few  major  variables  v;hich  could  be  measured  was  used* 
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Research  Procedures 

Assigning  individuals  to  groups 

The  sixteen  individuals  v/ho  registered  for  Program 
Development  and  Evaluation  (ADT  5^18)  during  the  winter 
quarter  of  1972  at  The  Florida  State  University  constituted 
the  sample  selected  for  this  study.    Registrants  were 
matched  and  randomly  assigned  to  two  groups  of  eight  members 
each  basied  on  their  scores  on  (1)  Rokeach's  Dogmatism 
Scale,  Form  E;  (2)  a  questionnaire  regarding  their  previous 
group  process  training  and/or  experience  in  groups,  and 
(3)  a  Pre-Test  of  Program  Development  and  Evaluation. 
Through  this  procedure  the  researcher  attempted  to  control 
for  those  factors ' identified  in  the  research  literature 
as  influencing  group  effectiveness  other  than  those  v/hich 
would  be  explicitly  treated. 

Treatment 

The  experimental  group  received  twelve  hours  of 
group  process  training  from  an  experienced  trainer.  This 
training  took  place  over  a  two-day  period  prior  to  their 
beginning  work  on  the  solutions  to  the  problems  submitted 
to  them. 

Data  collection:     group  process 

After  having  received  training  in  the  use  of  Jahns' 
Performance  Rating  Instrument,  two  raters  categorized  the 
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verbal  interaction  of  .the  control  and  experimental  groups 
from  the  v;ritten  transcriptions  prepared  from  the  tape 
recordings  of  the  group  meetings,  as  well  as  the  tape 
recordings  themselves.    Differences  in  the  categorizations 
were  resolved  through  discub  ions  with  the  raters.  Hence, 
consensus  was  achieved  on  all  the  group  interaction  ratings. 

Data  collection:     group  products 

Two  professors  of  Adult  Education  at  The  Florida 
State  University  a  >essed  the  quality  of  the  products  pro- 
duced by  the  trained  and  untrained  groups  according  to 
criteria  developed  by  this  investigator.    Each  judge  rated 
the  products  separately.    They  they  met  with  the  researcher 
to  reach  consensus  on  their  ratings  of  product  quality. 

Data  collection:     group,  cohesiveness 

Data  on  group  cohesiveness  were  collected  at  the 
last  class  session  of  ADT  5^8.    This  writer  collected  these 
data  by  administering  the  University  of  Oklahoma  Group 
Cohesiveness  Scale  to  the  members  of  both  the  trained  and 
untrained  groups . 

Data  collection;  achievement 

The  achievement  data  were  collected  immediately 
before  implementation  of  the  study  at  the  first  class  meeting 
and  just  prior  to  its  conclusion  at  the  last  class  meeting. 
The  investigator  collected  these  data  by  administering  a 


pre  and  post-test  covering  the  content  of  the  course: 
Program 'Development  and  Evaluation, 

Data  analysis 

After  the  collection  of  the  interaction  data  v/as 
completed,  the  number  of  contributions  over  all  three 
categories  was  summed  for  each  individual  in  each  group 
for  the  eight  sessions  in  which  he  participated.  The 
responses  of  individuals  v/ho  were  absent  from  one  of  the 
group  sessions  were  corrected  by  determining  their  char- 
acteristic interaction  rate  in  each  category  and  adding 
this  to  his  total.    The  P-Test  was  used  to  test  for  a 
significant  difference  between  the  two  variances  of  the 
member  contributions  of  the  trained  and  untrained  groups. 

To  compare  the  self-oriented  and  group-oriented 
contributions  of  the  trained  and  untrained  groups,  the 
responses  p'/  ,assion  of  each  group  in  each  category  (self 
and  group,  respectively)  v/ere  converted  to  percentages. 
These  percentages  were  ranked  and  the  rank  sums  for  the 
groups  analyzed  for  significant  difference  using  the  V/ilcoxon 
Rank  Sum  Test . 

Data  were  also  generated  relating  to  the  quality  of 
the  products  produced  by  the  trained  and  untrained  groups. 
Using  the  consensus  scores  of  the  two  judges,  differences 
in  the  quality  of  the  products  were  analyzed  for  signifi- 
cance using  the  Wilcoxon  Matched  Pairs  Signed  Ranks  Test. 
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Data  concerning  group  soheslvenoss  v^as  analyzed  by 
ranking  each  individual's  group  cohesiveness  score  in  each 
group.    The  rank  sums  for  the  trained  and  untrained  groups 
were  then  analyzed  for  significant  difference  using  the 
Wilcoxon  Rank  Sum  Test. 

Still  another  analysis  was  conducted  comparing  the 
data  regarding  gain  in  achievement  in  course  content  between 
individuals  in  the  trained  group  and  those  in  the  untrained 
group.    'Each  individual's  gain  score  was  ranked  and  the  rank 
sums  of  both  groups  analyzed  for  significant  difference  . 
using  the  Wilcoxon  Rank  Sum  Test. 

The  Findings 

The  findings  in  this  study  are  summarized  in  terms 
of  the  research  hypotheses  as  follows: 

1.  A  group  which  has  received  group  process  training 
will  evidence  a  significantly  greater  distribution  ■ 
of  participation  among  its  members  than  a  group 
which  has  not  received  group  process  training. 

2.  A  group  which  has  received  group  process  training 
will  make  a  significantly  smaller  percentage  of 
self-oriented  contributions  than  will  a  group  which 
has  not  received  group  process  training. 

3.  A  group  which  has  received  group  process  training 
will  make  a  significantly  higher  percentage  of 
group  oriented  contributions  than  villi  a  group 
v/hich  has  not  received  group  process  training. 

There  was  a  significantly  greater  distribution  of 

participation  among  the  members  of  the  trained  group.  The 

trained  group  made  a  significantly  smaller  percentage  of 

self-oriented  contributions  than  did  the  untrained  group. 
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The  group  v/hich  received  group  process  training  also  made 

a  higher  percentage  of  group  oriented  contributions. 

1».    A  group  which  has  received  group  'process  training 
will  produce  a  significantly  higher  quality 
"Philosophy-Policy"  product  than  v/ill  a  group 
which  has  not  received  group  process  training. 

5.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Strategy"  product  than  wiir.  a  group  which  has 
not  received  group  process  training. 

6.  A  group  v/hich  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
■"Criterion  System"  product  than  will  a  group  which 
has  not  received  group  process  training. 

7.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Community-Level  Objectives"  product  than  will  a 
group  which  has  not  received  group  process  training. 

8.  A  group  which  has  received  group  process  training 
will  produce  a  significantly  higher  quality 
"Analysis  of  a  Community -Level  Objective"  product 
than  will  a  group  which  has  not  received  group 
process  training. 

With  the  exception  of  the  Philosophy-Policy  product, 
the  group  which  received  group  process  training  produced 
significantly  higher  quality  solutions  to  problems  submitted 
to  it  as  evidenced  by  its  group  products  than  did  the  group 
which  did  not  receive  group  process  training. 

9.  A  group  vmich  has  received  group  process  training 
will  evidence  significantly  greater  group  cohe- 
siveness  than  a  group  which  has  not  received  group 
process  training. 

There  was  a  significant  difference  in  group  cohesive- 
ness  between  the  trained  and  untrained  groups  with  the  differ 
ence  being  in  the  direction  hypothesized. 
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10.    Individuals  in  a  group  which  received  group  process 
training  will  exhibit  significantly  greater  gains 
la  achievement  in  course  content  than  will  indivi- 
duals in  a  group  which  did  not  receive  group  process 
training. 

There  was  no  significant  difference  in  gain  in 
achievement  between  individuals  in  the  trained  group  and 
those  in  the  untrained  group. 

Conclusions 

Based  on  the  procedures  outlined  above  and  the 
findings  reported,  severa]  conclusions  are  drawn  in  regard 
to  this  study.    However,  before  discussing  any  conclusions, 
there  are  limitations  to  this  investigation  that  should 
be  kept  in  mind  when  interpreting  the  findings.    To  begin, 
only  regiGt'rants  of  one  graduate  cou.'^sc  in  adult  education 
at  one  university  made  up  the  sample  population.  Therefore, 
the  findings  may  be  applicable  to  other  individuals  or 
groups  only  in  so  far  as  they  have  characteristics  that 
are.  similar  to  the  participants  in  this  study. 

Another  limitation  may  be  in  the  special  nature  of 
the  problems  submitted  to  <?ach  group.    Not  all  problem 
situations  constitute  interdependent  multi-stage  tasks.  In 
addition,  research  has  shown  that  different  externally 
Imposed  problems  place  different  demands  on  a  group.  Thus, 
generalizations  based  on  the  obtained  results  may  only 
apply  to  problems  of  a  similar  nature  to  those  employed 
in  this  study. 
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As-AlXuded  to  earlit-r  1.n. ^tl4e^^acxtiQii_C)a. J heoretlo^al 
considerations,  only  a  few  of  the  many  variables  that  make 
up  the  total  psychological  field  of  an  individual  were 
considered  in  this  study*    Hence,  several  variables  which 
were  unaccounted  for  may  have  influenced  the  procedures 
and  the  outcomes  of  this  research.    For  example,  it  is  a 
frequently  reported  phenomenon  that  one's  participation  in 
a  training  program  sometimes  results  in  heightened  motiva- 
tion*    This  factor  v/as  only  partially  controlled  in  this 
study.    It  was  assumed  by  this  investigator  that  any 
motivational  differences  between  trained  and  untrained 
groups  v/ould  be  dissipated  by  the  fact  that  indi  /iduals 
in  ^oth  groups  we<K*e  enrolled  in  a  graduate  course  and 
needed  a  good  grade.    To  what  extent  this  assumption  was 
valid  is  not  now  known. 

Another  qualification  would  seem  to  stem  from  the 
nature  of  the  training  itself.    The  present  study  employed 
twelve  aours  of  group  process  training  prior  to  the  trained 
group  engaging  in  its  problem  tasks.    Information  as  to 
whether  the  same  effects  could  be  achieved  v/ith  other  types 
of  training  strategies  is  not  available  from  this 
investigation. 

Finally,  despite  the  efforts  of -this  writer  to 
consciously  control  for  the  possible  effects  of  her  own 
biases,  it  is  still  possible  that  this  variable  influenced 
the  results.    Similarly,  the  several  persons  who  assisted 
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with  the  data  collection  could  have  unconsciously  allowed 
their  biases  to  influence  their  judgments  relative  to  the 
quality  of  the  group  interaction  ani  .  or 'the  group  products. 

With  these  limitations  in  mind,  and  on  the  basis  of 
the  findings  in  this  study,  the  follov/ing  conclusions  were 
reached: 

1.  Group  process  training  does  contribute  to  the 
quality  of  group  interaction  as  evidenced  by  a 
greater  distribution  of  participation  among  the 
group  member5>,  a  smaller  percentage  of  .-»elf- 
oriented  contributions,  and  a  greater  percentage 
of  group  oriented  contributions. 

2.  Group  process  training  does  contribute  to  the 
quality  of  group  problem  solving  as  evidenced  in 
the  quality  of  the  group  products  v:ith  the  exception 
of  the  ''Philosophy-Policy"'  product. 

3.  Group  process  training  does  contribute  to  the  amount 
of  group ^cohesiveness . 

4.  Group  process  training  was  not  found  to  be  related 
to  gains  in  course  content  achievement. 

Implications 

Implications  for  theory 

A  basic  assumption  in  this  study  derived  from  the 
social  psychological  theory  that  group  members  have  indivi- 
dual needs  which,  if  not  met,  inhibit  the  effectiveness 
of  the  group.    Therefore,  it  was  proposed  that  training  in 
group  membership  skills  would  enable  the  group  to  better 
meet  the  individual  needs  of  its  members  such  that  the  group 
would  interact  more  effectively. 
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This  theoretical  view  was  supported  to  the  extent 
that  a  significant  relationship  was  found  between  group  ^ 
process  training  and  the  quality  of  group  interaction. 
The  group  \;hich  received  group  process  training  made  fewer 
attempts  to  satisfy  their  ovm  individual  needs  which  were  * 
negatively^  oriented  to  the  needs  of  others  in  their  group 
as  evidenced  by  a  smaller  percentage  of  self  oriented 
contributions.    In  addition,  members  of  the  trained  group 
expresse.d  greater  concern  about  the  feelings  and  opinions 
of  their  fellow  group  members.    This  can  be.  seen  in  their 
larger  percentage  of  group  oriented  contributions.  The 
group  v;hich  received  group  process  training  also  exhibited 
a  more  even  distribution  of  contributions  among  its  members. 
This  seems  to  indicate  that  they  were  employing  skills/ 
practices  designed  to  facilitate  the  expression  of  ideas 
and  opinions  from  all  the  members  such  that  they  were  making 
more  effective  use  of  their  member  resources. 

A  second  assumption  came  from  the  theoretical  view 
that  group  process  training  would  provide  a  group  with 
the  necessary  skills  so  that  it  could  effectively  integrate 
its  task  and  interpersonal  concerns.     It  was  therefore 
proposed  that  group  process  training  would  release  the 
group's  available  resources  which  could  then  be  devoted 
to  producing  qualitatively  superior  solutions  to  problems 
submitted  to  it. 
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This  theoretica.1  point  of  view  was  supported  to 
the  extent  that  four  of  the  five  products  developed  by  the 
trained  croup  were  significantly  superior-  in  quality  to 
those  produced  by  the  untrained  group.    The  lack  of  signi- 
ficant relationship  between  group  process  training  and  the 
quality  of  the  Philosophy-Policy  product  may  reflect  the 
differential  nature  of  this  product  than  that  represented 
by  the  other  products.    It  deals  more  than  the  other  four 
with  the- beliefs  and  values  of  the  group  members  regarding 
adult  education.    Another  explanation  might  be  that  the 
evaluation  scales  used  to  rate  this  product  may  not  have 
possessed  the  sensitivity  necessary  to  detect  the  qualitative 
differences  between  the  two  products.    Then,  too,  this  was 
the  first  product "dealt  with  by  the'  trained  group.    They  may 
have  needed  more  practice  in  the  group  membership  skills 
they  obtained  from  the  training. 

A  third  assumption  derived  from  the  theoretical 
view  that  if  members  of  a  group  possess  the  group  mainte- 
nance skills  necessary  to  satisfy  the  interpersonal  needs 
of  their  fellow  members,  there  would  be  less  frustration 
and  member  dissatisfaction  with'  their  group.    Therefore,  it 
was  proposed  that  group  process  training  would  result  in  a 
higher  level  of  group  cohesiveness . 

This  theoretical  viewpoint  was  supported  in  that  a 
significant  relationship  was  found  between  group  process 
training  and  a  higher  level  of  group  cohesiveness. 
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A  fourth  assumption  derived  from  the  theoretical 
viev/  that  a  group  trained  in  effective  membership  skills 
would  be  able  to  resolve  the  socio-emotional  needs  of  its 
members  which  might  be  expected  to  interfere  with  learning. 
Therefore,  it  v/as  proposed  that  individuals  in  a  group  which 
had  training  in  group  processes  would  make  greater  gains  in 
achievement  of  course  content  than  would  a  group  v;hich  had 
not  received  the  training.    This  theoretical  viewpoint  was 
not  supported  to  the  extent  that  the  trained  group  did  not 
evidence  significantly  greater  gains  in  achievement  than 
the  untrained  group.    A  possible  explanation  is  that  training 
in  group  membership  skills  has  negligible  effects  on  content 
learning.    One  alternate  explanation  is  that  the  instrument 
used  to  measure  a^chievement  in  course  content  was  not 
sufficiently  sensitive  to  detect  achievement  differences 
betv/een  the  individuals  in  the  two  groups.    Still  another 
explanation  for  the  obtained  results  may  lie  in  the  fact 
that  the  study  participants  were  enrolled  in  a  course  for 
graduate  credit  and  the  post -test  was  "billed''  as  a  final 
exam.    This  may  have  bolstered  the  motivation  of  individuals 
in  both  groups  to  study  for  the  testj  thereby  dissipating 
any  differences  in  favor  of  the  experimental  group. 

The  findings  of  this  research  contribute  to  the 
existing  body  of  group  dynamics  literature  by  not  only 
suggesting  a  training  strategy  that  works  with  a  variety 
of  problems;  but  also  by  providing  .experimentally  grounded 
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knowledge  as  to  what  variables  in  group  interaction  are 
affected  by  training.    These  findings  thus  support  the  main 
theoretical  assumption  of  this  study  that  training  in  group 
processes  can  alleviate  the  factors  which  Inhibit  group 
effectiveness. 

Implications  for  furcher  research 

This  study  revealed  several  implications  for  research 
in  regard  to  methodological  considerations  v/hen  conducting 
studies 'involving  groups;    One  problem  indicated  by  this 
study  was  the  gap  between  what  was  said  in  the  group  and' 
what  actually  was  written  up  in  the  group  product.  This 
suggests  that  the  role' of  recorder  in  a  group  is  a  pivotal 
one.    His  level,  of  competence  may  account  for  some  of  the 
variability  in  the  quality  of  a  group's  product.  Similarly, 
the  quality  of  a  group's  product  may  reflect  not  only  the 
quality  of  a  particular  solution  to  a  problem;  but  also 
the  writing  ability  of  the  group  members.    The  group  product 
judges  reported  difficulty  in  separating  the  quality  of 
what  was  written  from  the  way  it  was  written.  Such 
methodological  problems  should  be  recognized  by  other 
investigators  who  are  contemplating  using  the  quality  of 
group  products  as  a  criterion  of  group  effectiveness. 

Another  methodological  problem  revealed  in  this 
study  was  in  the  provision  of  "like"  conditions  for  the 
control  group.    As  noted  under  limitations  of  this  study. 
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just  by  receiving  training  a  group  may  experience  a  sense 
of  heightened  motivation  which  may  affect  the  outcome  of 
the  study.    Thus,  a  suggestion  to  other  researchers  inter- 
ested in  the  effects  of  group  process  training  would  be  to 
provide  a  placebo  type  of  training  experience  for  the 
control  group  to  eliminate  this  confounding  variable. 

This  study  has  barely  touched  upon  the  possibilities 
of  group  process  training  for  affecting  the  performance  of 
a-  group.    The  question  arises  of  t^hether  similar  results 
to  those  reported  in  the  present  study  could  have  been 
obtained  with  different  training  strategies.    Given  the 
significant  superiority  of  the  trained  group  in  this  investi- 
gation, studies  employing  training  provisions  in  their 
designs  which  focus  upon  the  comparison  of  different 
training  strategies  and  the  unique  effects  of  training  per 
se  would  seem  to  be  in  order. 

Specific  suggestions  for  the  conduct'  of  further 
research  other  than  those  stated  above  are:     (1)  Increase 
the  sample  size;  (2)  Vary  the  research  setting;  (3)  Vary 
the  nature  of  the  problems  submitted  to  the  groups;  and 
(^1)  Vary  the  population  characteristics  of  the  study  parti- 
cipants.   These  changes  should  aid  in  detecting  relationships 
amonc  the  variables  and  in  generalizing  from  the  findings. 

Implications  for  practice 

A  major  practical  implication  of  this  study  is  that 
individuals  who  desire  the  greatest  utilization  of  the  problem 


75 

solving  abilities  of  groups  now  have  a  method  to  help 
ensure  the  success  of  their  groups.    Group  process  training 
has  been  found  to  modify  group  Interaction  such  that  quail-- 
tatively  superior  solutions  to  problems  can  be  produced. 
This  has  fair-reaching  implications  given  the  present  trend* 
tov;ard  participative  management  and  group  problem  solving. 

As  this  study  reveals,  training  in  group  processes 
will  facilitate  higher  quality  group  interaction.    Much  more 
effort  is  expended  in  the  direction  of  supporting  the 
group  and  much  less  in  meeting  individual  needs  at  the 
expense  of  the  group.    More  effort  is  taken  to  draw  out 
the  low  participators  and  thus  make  their  ideas  and  opinions 
available  to  the  group.    V/ithout  group  process  training 
participants  are  largely  concerned  with  the  content  of  the 
discussion  and  the  importance  of  process  is  neglected. 
It  can  be  inferred  from  the  findings  of  the  present  research 
study  that  group  process  training  not  only  induces  superior 
collaborative  problem  solving,  but  also  greater  satisfaction 
with  the  solution.    Thus,  it  might  be  expected  that  there 
\^ould  be  a  greater  commitment  to  act  upon  those  solutions. 
Hence,  one  of  the  areas  where  ^roup  process  training  may 
have  its  greatest  potential  is  iu  the  area  of  community 
development  where  the  problems  dealt  with  are  so  cricial 
and  pressing.    Here,  creative  solutions  are  not  enough; 
there  must  be  a  commitment  to  acti-^* 
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To  conclude,  given  the  increasing  involvement  of 
groups  in  problem  solving;  the  practical  question  is  no 
longer  whether  to  use  groups,  but  rather -how  to  ..se  them 
most  effectively.     It  is  to  this  quDstion  that  this 
research  speaks  to  most  clearly.    Tie  major  practical 
implication  of  this  study  is  that  it  is  possible  to 
maximize  the  resources  that  a  problem  solving  group  has 
available  to  it  through  the  use  of  group  process  training. 


MEASURING  ROLE  ACQUISITION  BY  TEACHER  AIDES  IN  HEAD  START  CENTERS  * 


IVederick  W»  Peck 


This  paper  presents  a  simple  method  for  measuring  the  extent  of 
work  role  acquisition  of  one  gi-oup  of  paraprofessionals  (teacher  aides) 
in  one  type  of  hunian  service  organization  (Head  Start) .    As  adult  educators 
know  so  veil,  nuch  is  said  and  vritten  about  the  ways  that  children  are 
somehow  transformed  with  varying  degrees  of  success  into  acceptable  members 
of  society  and  of  society's  subsystems.    But  at  the  same  time  very  little 
is  said  about  the  process  by  vhich  adults  themselves  are  subs>>quently  trans- 
formed   into  "even  more  acceptable"  members  of  society  and  of  certain  of 
their  society's  subsystems  ~  particularly  the  occiqpational  subsystem. 

The  development  of  instrumentation  to  measure  the  extent  of  role 
acquisition  of  persons  in  particular  occupational  categories  is  a  first 
step  in  any  effort  to  determine  the  extent  to  which  certain  persons  have 
'learned  their  jobs".    Such  instrumentation  enables  researchers  to  dif-- 
ferentiate  between  persons  who  have  in  fact  learned  their  jobs  veil  and 
persons  vho  liave  not.    Then  having  divided  incumbents  of  a  position  into 
different  catcgories-^e.g.  "high  role  acquirers"  vs.  '"lovTrole  acquirers"--- 
it  is  possible  to  go  on  to  formulate  research  questions  regarding  the  r^ro-- 
cess  by  vhich  the  persons  acquired  their  work  roles,  the  agents  operative 
in  this  process,  and  so  forth.    The  method  for  measuring  work  role  acqui- 
sition described  in  this  paper  grew  out  of  a  practical  need— i.e.  to  find  a 
simple  way  to  go  into  an  organization  and  quickly  identify  employees  vho 
have  learned  their  jobs  veil  and  employees  vho  have  not. 

The  Role  Acquisition  Measure  vhich  is  the  subject  of  this  paper 
focuses  entirely  on  teacher  aides  in  Head  Start.    Aides  from  this  partic- 
ular k?nd  of  organization  were  chosen  because  l)  Head  Start  teacher  aide 
tasks  ere  very  much  the  same  from  center  to  center  j  vhile  at  the  same  time 
2)  Head  Start  centers  are  ne\r  enough  organisational  forms  not  to  have 
established  a  rigid  set  of  expectations  regaraing  the  aide  position. 


Paraprofessionals  in  Head  Start 

Persons  vho  function  in  hviman  service  organizations  imder  the  gener- 
ic title  of  paraprofessional  (aide)  ai-e  creatures  of  vide  scale  disenchant- 
ment ^vith  traditional  methods  of  sei-vice  delivery  in  all  areas  of  the  human 
services.    They  came  to  the  fore  as  possible  solutions  to  tvo  separate,  ^ut 
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for  a  while  allied,  concerns  of  the  1960's. 

Sinply  stated,  the  first  concern  was  how  to  supply  more  services 
to  persons  in  need.    The  argument  was  that  the  human  service  professional 
had  over  time  "become  burdened  with  accumiaated  non-professional  duties. 
Providing  non-creaentialed  paraprofessionaDs  to  work  with  the  professional 
vould  free  the  professional  to  do  the  work  for  which  he  or  she  had  been 
trained  and  subsequently  hired,  thereby  increasing  the  quantity  of  service. 
An  implication  is  that  professional  expertise  is  sufficient,  but  bogged 
down.    This  may  be  called  the  "non-professional"  model  of  aide  utiliza- 
tion (l).    Teacher  aides  in  public  schools,  home  health  aides  in  public 
health  departments,  and* casework  aides  in  welfare  departments  may  gener- 
ally be  considered  expressions  of  this  model  of  aide  utilization. 

The  second  concern  was  how  to  supply  better  (and  therefore  differ- 
ent) services  to  persons  in  need.    This  concern  was  marked  by  grave 
reser^'-ations  regarding  the  ability  of  professional  services,  as  presently 
constituted,  to  solve  basic  social  problems.    New  programs  were  designed 
to  be  staffed  largely  by  aides  who  had  earned  their  credentials  "in  the 
street"  rather  than  through  traditional  middle  class  channels.    An  impli- 
cation is  that  professional  expertise,  bogged  down  or  not,  is  irrelevant. 
This  may  be  called  the  "new-professional"  model  of  aide  utilization. 
Neighborhood  aides  in  commvmity  action  programs  and  mental  health  centers 
may  generally  be  considered  exTpressions  of  this  model  of  aide  utilization. 

Holding  to  both  concerns,  and  likewise  conmtted  to  combining  as- 
pects of  both  models  of  aide  utilization,  some  programs  emerged  with  a 
third  strategy.    Expert  professional  and  indigenous  aides  were  to  join 
hands  and  attack  a  particular  social  problem  together.    Functioning  as  a 
team,  they  would  involve  themselves  in  problematic  situations  that  neces- 
sitated joint  problem  solving.    The  professional  would  bring  to  this 
partnership  generalized  knowledge  and  diagnostic  skills;    the  aide  would 
bring  the  insider's  ability  to  understand  and  in^.erpret  client  behaviors, 
and  a  natural  capacity  to  f^onction  as  go-between  for  client  and  profes- 
sional.   An  implication  was  that  professional  expertise  is  essential,  but 
invariably  partial.    This  may  be  called  the  "para-professional"  model  of 
aide  utilization.    Teacher  aides  in  Head  Start  may  be  considered 
expressions  of  this  model. 

By  any  measure  paraprofessionals  are  a  new  occupational  category. 
There  is  yst  to  emerge  a  stereotypical  "role  of  the  paraprofessional"  bo 
which  new  paraprofessionals  may  relate.    Established  occupations  require 
that  new  incumbents  of  a  position  relate  to  a  r^le  that  is  generally  veil 
defined  ~  a  requirement  that  places  on  these  individuals  the  burden  of 
xindergoing  a  process  of  role  acquisition.    This  process  is  highly  problem- 
atic even  for  those  whose  positions  are  well  defined.    The  process  is  even 
more  formidable  for  paraprofessionals.    There  are  few  established  behaviors 
for  the  person  who  enters  a  paraprofessional  position.    Her  own  under- 
standing of  her  role  may  have  been  somewhat  influenced  by  exposure  to 
other  aides  who  are  operating  under  either  the  non-professional  or  the  new- 
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professional  model ♦    More  likely  she  has  had  no  exposure  to  any  other 
aides      at  all.    She  may  he  the  first  to  occupy  the  position  she 
presently  holds.    There  is  definitely  an  ambiguity  to  the  role  of 
the  teacher  aide  in  Head  Start.    And  this  aratiguity  may  te  assumed 
to  have  produced  a  corps  of  teacher  aides  whose  role  acquisition 
ranges  from  extensive  to  minimal. 

Role  Acquisition 

Kov^  of  what  is  known  atout  role  acquisition  has  emerged 
ftrom  the  tradition  of  inquiry  known  as  "socialization"  (2)..  And 
indeed  role  acquisition  protatly  constitutes  the  most  important 
aspect  of  socialization,  at  least  as  it  applies  to  adultg  (S).*  In 
its  "broadest  sense  socialization  is  a  process  ty  which  people  ac- 
quire the  requisite  knowledge,  skills,  and  dispositions  to 
function  as  members  of  society  {k) .    In  the  case  of  this  paper's 
teacher  aides,  it  is  the  process  "by  which  they  are  able  to  learn 
the  expectations  of  others,  go  on  to  accept  these  expectations,  and 
eventually  to  fulfill  them  (5). 

What  is  assumed  is  that  being  named  a  teacher  aide  does  not 
constitute  acquisition  of  the  role  of  the  teacher  aide;  it  simply 
sets  a  particular  socialization  process  in  motion.  Moreover,  there 
are  many  people  in  the  teacher  aide's  work  setting — director,  fam- 
ily worker,  nurse,    psychologist,  cook,  bus  driver  (and  beyond  her 
cu-vorkers  the  children,  their  parents,  and  other  residents 
of  the  community).    These  people  have  numerous  (and  occasionally 
conflicting)  expectations  for  her.    She  must  continuously  work  to 
learn,  accept  and  fulfill  the  expectations  of  each  one  of  them  (6). 
But  above  all  she  must  acquire  her. role  through  interaction  with 
the  persons  with  whom  she  works  most  closely.    And  of  all  these 
persons,  her  closest  working  relationship  is  with  her  supervising 
teacher.    The  teacher  aide's  role  comes  into  being  as  a  set  of  ex- 
pectations (7),  and  no  one  has  more  expectations  for  her  than  her 
co-habitant  of  the  classroom,  the  teacher.    To  measure  role  acqui- 
sition by  teacher  aides  in  Head  Start  is  foremost  an  effort  to  as- 
sess to  what  extent  the  teacher  aide  has  learned,  accepted,  and 
fulfilled  the  expectations  of  her  supervising- teacher.    The  Role 
•  Acqiaisition  Measure  then  identifies  teacher-pleasing  teacher  aides. 

Role  learning.    Learning  one's  role  is  a  first  step  in  role, 
acquisition.    The  concept  of  role  learning  grows  out  of  what  some 
role  theorists  refer  to  as  a  "role  perspective"  which  emphasizes 
the 

...controlling  power  of  one's  environment  [and  therefore] 
reflects  a  doctrine  of  limited  social  determinism.  The 
behavior  of  the  individual  is  examined  in  terms  of  how  it 
is  shaped  by  the  demands  and  rules  of  others. .  .This  per- 
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spective  does  not  deny  the  facts  of  individual  differences, 
but  it  does  highlight  the  social  determinants  that  may  have 
entered  into  creating  such  differences,  and  it  does  focus 
the  role  analyst's  attention  upon  the  conditions  under  which 
the  social  determinants  will  be  more  rather  than  less 
influential.  (8) 

Viewed  from  this  perspective,  the  learning  of  role  has  traditionally  gained 
articulateness  by  the  use  of  dramaturgical  metaphor  (9). 

"All  the  world's  a  stage. 

And  all  the  men  and  women  merely  players: 

They  have  their  exits  and  their  entrances...  . 

(And  true  to  the  assumptions  of  socialization  theory) , 

•••one  man  in  his  time  plays  many  parts. .. (lO) . 

In  this  sense  a  teacher  aide  in  Head  Start  is  stage  center.  Her 
role  is  presented  to  her  as  a  script  to  be  learned,  and  her  supervising 
teacher  is  both  a  script  writer  and  director.    In  the  langmge  of  the 
role  analyst,  the  teacher  is  a  "role  sender"  (ll),  formulating  expecta- 
tions and  dispatching  them  to  the  teacher  aide  in  the  form  of  "sent 
roles".    The  teacher  aide  is  a  "focal  person",  receiving  the  sent  role 
and  fashioning  what  she  hopes  is  an  appropriate  behavioral  response.  The 
appropriateness  of  that  behavioral  response  is  indicated  to  the  teacher 
aide    by  the  teacher,  who  incorporates  her  evaluation  in  her  next  sent 
role.    The  process  is  one  of  endless  recycling,  fueled  by  the  aide's  need 
to  please  and  the  supervisor's  need  to  control.    The  script  is  written  on 
the  run;  the  play  unfolds.    Role  is  learned. 

But  how  to  measure  this  learning?    Surely  the  existence  of  some 
single,  stable  "role  of  the  teacher  aide"  is  unlikely,  given  the  above  des- 
cription of  role  learning.    It  is  more  likely  that  there  are  as  many  roles 
for  the  teacher  aide  as  there  are  role  senders  to  send  them  out.    To  dis- 
cern the  amount  of  role  learning  by  a  particiilar  teacher  aide  requires 
measuring  that  aide's  knowledge  of  the  expectations  her  own  particular 
teacher  holds  for  her.    Teacher  aide  and  teacher  must  be  examined  together, 
received  role  being  compared  to  sent  role.    The  range  of  learning  is  mapped 
out  dyad  by  dyad. 

A  recent  study  by  James  A.  Young  (l2)  identified  and  validated  spe- 
cific responsibilities  that  might  be  performed  by  the  Head  Start  teacher 
aide.    Utilizing  twenty  of  these  responsibilities  it  was  possible  to  con- 
struct instruments  to  assess  both  what  the  teacher  aide  thinks  is  expected 
of  her  (the    Received  Role  Measure  ) ,  and  what  the  teacher  does  in  fact 
expect  (the  Sent  Role  Measure).    By  comparing  responses  of  teacher  and 


teacher  aide  within  a  (Syad,  it  indicates  the  extent  to  which  an  individ- 
ual teacher  aide  has  learned  her  role. 

Role  acceptance.    Learning  one's  role  is  an  importart  first  step 
in  role  acquisition,  but  it  must  be  followed  by  a  second:    role  accept- 
ance.   The  teacher  aide  must  be  able  to  go  beyond  objective  understand- 
ing of  the  role  to  subjective  compliance  with  that  role.  .  Compliance  in 
its  most  general  sense  refers  to  a  relationship  between  those  who  have 
power  and  those  over  whom  power  is  exercised  (13).    In  a  more  limited 
sense  it  refers  "to  the  orientation  of  the  subordinated  actor  to  the 
power  implied."  (ik)    Once  the  role  is  learned,  there  is  an  implicit  re- 
action to  that  role  by  the  teacher  aide.    In  effect  she  will  begin 
either  to  "buy  into"  or  "back  off  from"  the  script  as  learned.    If  her 
reaction  is  negative,    the  result  will  be  alienation  and  role  acquisi- 
tion will  be  stymied.    If  on  the  other  hand  her  reaction  is  positive  and 
she  is  able  to  "accept"  the  learned  role,  then  the.  result  will  be  com- 
mitment:   role  acqvdsition  can  proceed. 

What  does  it  mean  to  "accept"  one's  role?    It  means  first  of  all 
that  the  teacher  aide's  orientation  to  organization  efforts  to  influence 
her  (i.e.  power)' is  positive.    Organization  efforts  nay  include  appeal- 
ing to  authority  it  is  hoped  the  teacher  aide  will  consider  legitimate. 
It  will  probably  include  the  use  of  rewards.    And  in  the  case  of  Head 
Start  it  will  surely  include  appeals  to  instrumental  identification  with 
the  norms  of  the  organization.    If  the  teacher  aide  feels  that  the  ap- 
peals to  authority  are  indeed  legitimate — that  is,  if  what  the  teacher 
or  director  may  require  of  her  is  felt  by  the  teacher  aide  to  be  con- 
gruent with  her  own  view  of  what  a  supervisor  has  a  right  to  expect,  then 
the  aide  may  accept  the  role.    If  the  teacher  aide  finds  the  organiza- 
tion's rewards — pay  raises,  promotions,  recognition  or  whatever — to  be 
congruent  with  her  own  needs,  then  the  aide  may  accept  the  role.    And  if 
the  teacher  aide  finds  the  values  of  the  organization  to  be  congruent 
with  her  o\m  values  (and  if  the  responsibilities  of  her  position  are  con- 
gruent with  the  values  of  the  organization)  ,  then  the  aide  may  accept  the 
role.    In  all  of  these  cases  the  aide  is  held  to  be  a  decision-maker  with 
go/no-go  authority.    She  can  stop  role  acquisition  in  its  tracks,  and  she 
can  start  it  up  again. 

Again,  utilizing  the  same  twenty  teacher  aide  responsibilities  it 
was  possible  to  develop  an  instrument  to  measure  acceptance  of  role  by 
individual  teacher  aides  (the  Role  Compliance  Measure). 

Role  fvilfillment .    The  final  step  in  role  acquisition  is  that  of 
role  fulfillment.    Having  learned  the  role  (more  or  less)  and  having  ac- 
cepted it  (more  or  less),  the  teacher  aide  acts.    It  is  this  action, 
this  behavior  in  role,  that  is  evaluated  by  the  teacher  (who  sent  the 
role  in  the  first  place).    The  teacher  relates  the  aide's  behavior  to  her 
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own  expectations  and  makes  some  judgment  as  to  the  appropriateness  of 
the  behavior.    Some  degree  of  role  fulfillment  or  non-fulfillment  is 
dxily  noted.    This  notation,  as  was  pointed  out  eai'lier,  is  incorpora- 
ted in  the  next  sent  role. 


Extent  of  role  fulfillment  then  is  determined  by  the  role 
sender — in  this  case  the  teacher  in  the  dyad.    It  was  possible  to  de- 
velop a  rating  form  (the  Role  Fulfillment  Measui'e)  to  meas^ore  this 
variable  of  role  acquisition,  and  therefore  to  be  able  to  ascribe  extent 
of  role  f\ilf illment  to  individual  teacher  aides . 


Summary.    Role  acquisition  is  a  concept  consisting  of  three 
variables:    role  learning,  role  acceptance,  and  role  fulfillment.  It 
has  been  possible  to  measure  the  extent  to  which  individual  teachez' 
aides  in  Head  Start  centers  possess  each  of  these  variables  by  deri- 
ving for  each  teacher  aide  a  siunmative  score  for  each  of  the  variables, 
thereby  indicating  her  position  on  a  scale  of  role  acquisition.  The 
teacher-pleas ers  can  then  be  identified. 


Measuring  Role  Acquisition 


Four  insti'uments  were  developed  to  determine  extent  of  role 
acquisition  by  teacher  aides  in  Head  Start:    the  Received  Role  Measure, 
the  Sent  Role  Measure,  the  Role  Compliance  Measure,  and  the  Role 
Fulfillment  Measure — all  constructed  around  twenty  of  the  teacher  aide 
responsibilities  validated  by  Yoxing. 

Measuring  role  learning.    To  neasure  role  learning  —  the  first 
component  of  role  acquisition  —  the  Received  Role  Measure  and  the 
Sent  Role  Measure  were  utilised.    The  Received  Role  Measure  is  incor- 
porated in  the^longer  "Teacher  Aide  Questionnaire"  (Appendix,  Item  l). 
The  Received  Role  Measiare  (Appendix,  Item  2)  gives  the  individual 
aide  an  opportunity  to  identify,  on  a  four  point  scale,  her  own  un- 
derstanding of  vrhat  her  supervising  teacher  expects  of  her  in.  regard  to 
each  of  twenty  specific  aide  responsibilities.    An  example  is  the  first 
of  the  twenty  aide  responsibilities,  "Making  visits  to  the  children's 
homes".    In  conjunction  with  this  responsibility  the  aide  is  given  the 
following  statement: 


THE  mCllER  I  WORK  WITH  FEELS  THAT  THIS  IS 
.  BESPONSiBILITY  Hi  VCilCH  All  AIDE  SHOULD... 


1. 

:ot  be 
wolved. 


2. 

occasionally 
be  involved 


3. 

usually  be 
involved. 


&lva.ys  be 
involved. 


(eb8ck  [y]  one) 


(  ] 


{  3 


The  teacher  aide  checks  one  of  the  four  boxes,  thereby  indicating  the 
role  she  has  received  from  her  teacher.    For  example,  if  she  were  to 
check  box  nmber  k  (as  illustrated  above),  she  would  be  stating  that 
she  has  received  the  following  role;    "As  a  teacher  aide  you  shoiild 
always  be  involved  in  mailing  visits  to  children's  homes". 

The  teacher  aide  then  goes  on  to  the  second  aide  responsibility, 
"Helping  prepare  and  serve  the  children's  food".    Again,  the  same  sta- 
tement (regarding  the  extent  of  aide  involvement)  is  given  in  conjunc- 
tion with  the  responsibility.    And  again  the  aide  checks  one  of  the 
boxes  (l,  2,  3,  or  1*).    In  this  fashion  the  aide  goes  through  all  of 
the  twenty  aide  responsibilities,  checking  box  1,  2,  3,  or  k.  Having 
T\m  through  the  twenty  responsibilities ,  the  teacher  aide  generates 
twenty  different  box  scores.    These  twenty  box  scores,  taken  in  order, 
are  her  "received  role  (involvement)  battery."    This  battery  comprises 
the  first  half  of  what  will  eventually  be  her  "received  role  battery*" 

The  Received  Role  Measure  continues,  repeating  the  same  twenty 
aide  responsibilities.    However,  it  can  be  seen  tliat  in  conjunction 
with  this  second  run-through  of  the  aide  responsibilities,  the  follow- 
ing (different)  statement  accompanies  each  of  the  responsibilities: 


GlVm  OUR  CEKTER^S  PRIORITIES,  TiiE 
TEACHER  I  WORK  VITH  CONSIDERS  THIS 
(PARTICULAR  RESPONSIBILITY  TO  BE.., 


1. 

2. 

3. 

^ne  of 

soncvhat 

very 

one  of 

ihe  least 

important. 

important . 

the  most 

Important. 

important 

(check  U]  one) 

[  •  J 

It  is  apparent  that  the  purpost=  of  this  second  half  of  the  Received 
Role  Measure  is  the  same  as  that  of  the  first  half  —  to  give  the  aide 
an  opportunity  to  identify,  on  a  four  point  scale,  her  ovn  understand- 
ing of  her  teacher's  expectations  regarding  each  of  tventy  specific 
aide  responsibilities. 

The  difference  in  the  second  half  is  that  where  the  first  half 
deals  with  the  extent  of  aide  involvement  in  particular  responsibilities 
the  second  half  deals  with  the  importance  of  those  responsibilities  to 
the  center's  overall  program.    So,  using  as  an  example  the  first  res- 
ponsibility   once  again,  the  aide  checks  one  of  the  four  boxes  under  the 
accompanying  statement.    If  in  this  case  she  were  to  check  box  number  2 
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(as  illustrated  above),  then  she  would  be  stating  that  she  has  received 
the  following  role  from  her  teacher:  "Given  our  center's  priori- 
ties, this  particular  aide  responsibility  is  somewhat  important 

The  teacher  aide  proceeds  to  the  second  aide  responsibility, 
then  to  the  third,  and  so  forth  through  the  twenty  responsibilities — 
each  time  checking  one  of  the  boxes  (l,  2,  3,  or  h) .    And  again  in  this 
rua-through  as  in  the  previous  run-through,  the  aide  generates  twenty 
different  box  scores.    These  twenty  box  scores,  fallen  in  order,  are  her 
"received  role  (importance)  battery".    This  battery  comprises  the  second 
half  of  her  "received  role  "battery". 

The-teachei*  aide  received  role  battery  then  is  simply  a  list  of 
forty  scores.    It  is  the  result  of  a  t-eacher  aide's  checking  one  box 
after  another  for  two  run-throughs  of  the  twenty  aide  responsibilities. 
Each  one  of  the  forty  scores  is  a  1,  2,  3,  or  i+.    How  this  received* 
role  battery  is. utilized  in  measuring  teacher  aide  role  learning  will  be 
explained  shortly. 

A  second  instrument,  the  Sent  Role  Measure,  is  also  utilized  in 
measuring  role  learning.'   The  Sent  Role  Measure  is  incorporated  in  the 
longer'^Teacher  Questionnaire"  (Appendix,  Item  3)  administered  to  teachers 
who  supervise  teacher  aides.    The  Sent  Role  Measure  (Appendix,  Item  h) 
gives  the  individual  teacher  an  opportunity  to  identify,  on  a  four 
point  scale,  what  she  expects  of  her  teacher  aidc(s)  in  regard  to  each 
of  twenty  aide  responsibilities.    (The  twenty  responsibilities  used  in 
the  Sent  Role  Measure  are  the  same  as  those  used  in  the  Received  Role 
Measure.)    Using  as  an  example  once  again  the  first  aide  responsibility, 
"Making  visits  to  the  children's  homes",  the  teacher  is  given  the 
following  statement; 


.AS  A  mCIITR  WHO  SUPERVIE2S  A  TEACIEP  /ILS, 
I  FEEL  TKAT  THIS  IS  A  RKSPONSIBILIirY  II{ 
WHICH  Alt  AIDE  SHOHTJ)... 


not  be 


2. 

occasionally 
be  involved. 


3. 

usuSLlly  be 
involved. 


gJ  v:\yc  be 
involved. 


(check. [y 3  one) 

iv4.  I    I  3 


[  ] 
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The  teacher  checks  one  of  tne  four  boxes,  thereby  indicating  the  role  she 
has  sent  to  her  teacher  aide*    If,  for  example,  she  were  to  check  box 
ntmiber  2  (as  illustrated  above),  she  would  be  stating  that  she  has  sent 
the  following  role:  "As  a  teacher  aide  you  should  occasionall?/-  be  in- 
volved in  making  visits  to  children's  homes*" 

The  teacher  then  goes  on  to  the  second  aide  responsibility, 
"Helping  prepare  and  serve  the  children's  food*"    Again,  the  same 
statement  (regarding  the  extent  of  aine  involvement)  is  given  in  con- 
junction with  the  responsibility.    And  again,  the  teacher  checks  one 
of  the  boxes  (l,  2,  3,  or  U) ,    In  this  fashion  the  teacher  goes  through 
>  all  of  the  twenty  aide  responsibilities,  checking  box  1,  2,  3,  or  1** 

^  Having  run  through  the  twenty  responsibilities ,  the  teacher  generates 

twenty  different  box  scores*  These  twenty  box  scores,  taken  in  order, 
are  her  "sent  role  (involvement)  battery*"  This  battery  comprises  the 
first  half  of  what  will  eventually  be  her  "sent  role  battery"* 

The  Sent  Role  Measure  continues,  repeating  the  same  twenty  aide 
responsibilities*    However,  as  in  the  case  of  the  Received  Role  Meas- 
ure, it  can  be  seen  that  in  conjunction  with  the  second  run-through 
of  the  aide  responsibilities,  the  following  (different)  statement  ac- 
companies each  of  the  responsibilities: 


GIVEN  OUR  CENTER •S  PRIORITIES,  I  CONSIDER 
THIS  PARTICULA.R  RE3P0IJSIBILITY  TO  BE... 


.  1. 

2. 

3. 

oae  of 

soaevhat 

very 

one  of 

the  leaat 

jjcportoat . 

important ♦ 

the  Eost 

Important  * 

Import ant. 

(check  [j)  one) 

• '  1 

I'M 

It  is  apparent  that  the  purpose  of  the  second  half  of  the  Sent  Role 
Measure  is  the  same  as  that  of  the  first  half  —  to  give  the  teacher 
an  opportunity  to  identify,  on  a  four  point  scale,  her  expectations 
regarding  each  of  twenty  specific  aide  responsibilities. 

As  in  the  previous  instrument,  the  difference  in  the  second 
half  of  this  instrument  is  that  where  the  first  half  deals  with  the 
extent  of  aide  involvement  in  particuJ.ar  responsibilities,  the  second 
half  deals  with  the  inrportance  of  those  tasks  to  the  center  ^s.  overall 
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program.    So,  using  as  an  example  the  first  responsibility  once  again, 
the  teacher  checks  one  of  the  four  boxen  under  the  accompanying  state- 
ment.   If  in  this  case  she  were  to  check  box  number  3  (as  illustrated 
above),  then  she  would  be  stating  that  she  has  sent  the  follovring  role 
to  her  teacher  aide:  "Given  our  center's  priorities,  this  particular 
aide  duty  is  very  important." 

The  teacher  proceeds  to  the  second  responsibility,  then  to  the 
third,  and  so  forth  through  the  twenty  reaponsibilities  —  each  time 
checking  one  of  the  boxes  (l,  2,  3,  or  h) .    And  again  in  this  run- 
through  as  in  the  previous  run-through •  the  teacher  generates  twenty 
different  box  scores.    These  twenty  box  scores,  taken  in  order,  are 
her  "sent  role  (iinportance)  batteiy."    This  battery  comprises  the  second 
half  of  her  "sent  role  bettery". 

The  teacher  .  ent  role  battery  tl)cn  is  simply  a  list  of  forty 
scores — as  was  the  earlier  teacher  aide  received  role  battery.    It  is 
the  result  of  a  teacher's  checking  one  box  after  another  for  two  rim- 
throughs  of  the  tvrenty  aide  reaponsibilities.    Each  one  of  the  forty 
scores  is  a  1,  2,  3,  or  1*.    This  sent  role  battery  is  utilized,  along 
with  the  received  role  battery,  in  measuring  teacher  aide  role 
learning. 

As  was  pointed  out  earlier,    in  order  to  measure  role  learning 
in  a  dyad,  teacher  and  aide  alike  must  be  exaanined  together — received 
role  being  compared  to  sent  role.    Obtaining  a  received  role  battery  and 
a  sent  role  battery  for  each  party  in  the  dyad  makes  this  comparison 
possible.    The  response  to  each  item  on  the  received  role  battery  is 
compared  to  the  response  on  the  corresponding  item  on  the  sent  role  bat- 
tery, the  difference  (O,  1,  2,  or  3)  being  dvily  noted.    By  way  of  il- 
lustration, it  will  be  remembered  that  in  preceding  examples,  on 
received  role  item  number  one  (regarding  making  visits  to  children's 
homes)  the  teacher  aide  checked  box  number  h\  while  on  sent  role  item 
number  one  the  teacher  checked  box  number  2.    This  indicates  a  received 
role  versus  sent  role  incongruence  (difference)  of  2  for  item  niaraber 
one. 

Role  learning  is  a  function  of  the  congruence  between  received 
role  battery  responses  and  sent  role  bettery  responses  in  a  dyad,  con- 
sidered item  by  item.    As  such  role  learning  is  the  sum  of  the  forty 
item  differences: 


where:    r^=  received  role  battery  response  for  item  number  one;  and 
Sij=  sent  role  battery  response  for  item  number  one;  etc. 
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A  result  of  this  suiming  of  differences  is  that  there  is  an  inverse 
relationship  hetveen  the  sm  of  the  differences  and  the  extent  of 
role  learning;  i.e*  the  lover  the  nvunber,  the  greater  the  role  learn- 
ing^  and  vice  versa.    In  the  interest  of  clarity,  it  is  possible  to 
make  a  simple  transformation  that  vill  make  the  relationship  "between 
the  s-uin  of  the  differences  and  the  extent  of  role  learning  a  direct , 
rather  than  invertie,  one.    The  sun  of  the  differences  may  he  subtracted 
from  the  constant  120  (the  maximum  sum  of  differences  possible — i,e,  the 
number  that  would  result  should  the  difference  on  each  of  the  forty 
items  be  3).    V7ith  this  transformation  included,  the  formula  for  role 
learning  is  as  follows: 

(Operational  definition:  L  =  "role  learning") 


Measixring  role  acceDtance,    Role  acceptance  —  the  second  com- 
ponent of  role  acquisition  —  utilizes  the  Received  Role  Measvire  and  the 
Role  Compliance  Measure.    The  Received  Role  I-lbasure  vas  just  described 
in  the  discussion  of  measuring  role  learning.    The  Role  Compliance 
Measui^e,  like  the  Received  Role  Measure,  is  incorporated  in  the"Teacher 
Aide  Questionnaire*!    The  Role  Compliance  Measure  (Appendix,  Item  5) 
gives  the  individual  aide  an  opportunity  to  identify,  on  a  fovir  point 
scale,  the  expectation  she  holds  for  herself  in  regard  to  each  of  the 
twenty  aide  responsibilities.    Tliis  expectation  may  be  considered  the 
aide's  "held  role",  distinctive  from  the  aide's  previously  described 
received  role,  and  from  the  teacher's  previously  described  sent  role. 

Continuing  the  example  of  the  aide  responsibility,  "Making  visits 
to  the  children's  homes'^  the  Role  Compliance  Measure  presents  the  follow- 
ing statement: 


AS  A  TEACHER  AIDE  I  FE5L  T}L\T  THIS  IS  A 
RESPOUSIBILITY  lU  TOICH  P2i  AIDE  SHOULD... 


1. 

not  be 
involved. 


2. 

occasionally 
be  involved. 


3. 

usually  be 
involved. 


1*. 

alvays  be 
invoive4 


(check  U]  one) 


[  1 


[  1 


The  teacher  aide  checks  one  of  the  four  boxes,    thereby  indicating  the 
role  she  has  received  from  her  teacher.    If  she  were  to  check  box 
number  1  (as  illustrated  above),  then  she  would  be  stating  that  her 
held  role  is  as  follows:  "As  a  teacher  aide  I  feel  that  this  is  a 
responsibility  in  which  an  aide  should  not  be  involved/' 

The  teacher  aide  proceeds  to  the  second  aide  responsibility, 
"Helping  prepare  and  serve  the  children's  food",  and  the  same  state- 
ment (x^egarding  the  extent  of  aide  involvenjent)  is  given  in  con- 
junction   with  the  responsibility.    In  this  (by  now  familiar)  fashion 
the  aide  goes  through  all  the  twenty  aide  responsibilities,  checking 
box  1,  2,  3,  or        Having  run  through  twenty  responsibilities ,  the 
teacher  aide  generates  twenty  different  box  scores.    These  twenty  box 
scores,  taken  in  order,  are  her  "held  role  (involvemer;t)  battery". 
This  battery  conq)rises  the  first  half  of  what  will  eventually  be  her 
"held  role  battery". 

The  Role  Compliance  Measure  continues,  repeating  the  same 
twenty  aide  responsibilities.    In  conjunction  with  this  second  run- 
through  of  the  aide  responsibilities,  the  following  statement 
accompanies  each  of  the  responsibilities: 


GIVEN  CUR  CENTER'S  PRIORITIES,  AS  A 
TKICllER-AIDS  I  CONGIDIR  THIS  F/UVTICULAR 
RESWlISlBILm  TO  BE... 


one  of 

the  lenst 
inportant  * 


2. 

scnevhat 
import snt* 


3- 

very 

ixcportant. 


(check  y]  one) 


one  of 
the  nosi 
iicportcx 


[  1 


[  1 


The  purpose  of  the  second  half  of  the  Role  Compliance  Measure  is  the 
same  as  that  of  the  first  half  —  to  give  the  teacher  aide  an  opportunity 
to  identify,  on  a  four  point  scale,  her  held  role  regarding  each  of 
twenty  specific  aide  responsibilities.    As  was  the  case  with  the 
instriMents  described  previously,  where  the  first  half  deals  with  the 
extent  of  aide  involvement,  the  second  half  deals  with  the  importance 
of  these  responsibilities  to  the  center's  overall  program.    So  again 
using  the  example  ol  the  first  responsibility,  if  the  teacher  aide 
were  to  check  box  number  h  (as  illustrated  above),  she  would  be  stating 
that  her  held  role  is:  "Given  our  center's  priorities,  as  a  teacher 
aide  I  consider  this  particular  responsibility  to  be  one  of  the  most 
important" > 
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The  teacher  aide  proceeds  to  the  second  responsibility,  then  to  the 
third,  and  so  forth  through  the  tventy  responsibil'',tj.es— -each  xime  checking 
one  of  the  boxes  (l,  2,  3,  or  k).    And  a^ain  in  this  run-throush  as  in  the 
previous  run-through,  ^he  teacher  aide  generates  tventy  different  box  5;cores. 
These  tventy  box  scores,  taken  in  order,  are  her  "held  role  (iniDortance) 
battery/'    This  battery  coniprises  the  second  half  of  her  "held  role  batteiy/' 

The  teacher  aide  held  ax>le  battery  then  is  siraply  a  list  of  forty 
scores— as  vere  the  earlier  teacher  aide  received  role  battery  and  the 
teacher  sent  role  battery.    It  is  the  result  of  a  teacher  aide's  checking 
one  box  after  another  for  tvo  run-throughs  of  the  tventy  aide  respo.isibili- 
ties.    Fach  one  of  the  forty  scores  is  a  1,  2,  3,  or  h.    This  held  role 
battery  is  utilized,  along  vith  the  received  role  battery,  in  measuring  • 
teacher  aide  role  acceptance. 

In  order  to  measure  role  acceptanca  by  an  individual  teacher  aide, 
received  role  must  be  compared  to  held  role.    Obtaining  a  received  role 
battery  and  a  held  role  battery  for  the  aide  laakes  this  comparison  possible. 
The  response  to  each  item  on  the  received  role  battery  is  compared  to  the 
response  on  the  corresponding  item  on  the  held  role  battery,  the  difference 
(0,  1,  2,  or  3)   being  duly  noted.    By  vay  of  illustration,  it  vill  be  re- 
membered tlxat  in  the  preceding  example,  on  received  role  itom  namber  one 
(regarding  raaiang  visits  to  children's  hor'^is),  the  teacher  aide  checked  box 
number  1;;  on  held  role  item  number  one  she  checked  box  number  k .  This 
indicates  a  received  role  versus  held  role  incongruence  (difference)  of 
zero  for  item  number  one. 

Role  acceptance  is  a  function  of  the  congruence  betveen  the  received 
role  battery  responses  and  the  held  role  battery  responses  of  a  teacher  aide, 
considered  item  by  item.    As  such  role  acceptance  is  the  sum  of  the  forty 
item  differences: 

I[r^-h^,  r^-hg,  r3^h3,  ...r^^^-h^^] 

vhere      =  received  role  battery  response  for  item  number  one;  h   =  held 
role  battery  response  for  item  number  one;  etc.    A  n^sult  of  this  sanming 
of  differences  is  that  there  is  an  inverse  relationship  betveen  the  sum  of 
the  differences  and  the  extent  of  role  learning;  i.e.,  the  lovrer  the  number, 
the  greater  the  role  learning,  and  vice  versa.    In  the  interest  of  clarity, 
it  is  possible  to  make  a  simple  transformation  that  vill  make  the  relation- 
ship betveen  the  sum  of  the  differences  and  the  extent  of  role  learning  a 
direct,  rather  than  inverse,  one.    The  sum  of  the  differences  w  be  sub- 
tracted from  the  constant  120  (the  maximum  sum  of  differences  possible— 
i.e.,  the  number  that  vould  result  should  the  difference  on  each  of  the 
forty  items  be  3).   With  this  transformation  inclxided,  the  iormula  for  role 
acceptance  is  as  follovs: 

A  =  120-1  [r^-h^,  V^2»  '^3-^3»  •••^liO^^cl 
(Operational  definition:   A  -  role  acceptance). 
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Measuria";  role  fuIfilLncnt.    Role  fulfillment  —  the  third  and  final 
component  of  role  acquisition  —  utilizes  the  Role  Fulfilment  l-leasure.  Tlie 
Role  Fulfillment  Measure  (Appendix,  Item  6)  like  the  Received  Role  Measure 
and  the  Sent  Role  Measure,  is  incorporated  in  the  Teacher  Questionnaire 
and  gives  the  individual  teacher  an  opportunity  to  rate  the  performance  of 
her  teacher  aide,  on  a  four  point  scale,  in  reeard  to  each  of  the  twenty 
aide  responsibilities.    Using  as  an  example  once  again  the  first  aide 
responsibility,  "Mailing  visits  to  the  children's  homes,"  the  teacher  is 
given  the'followins  statement: 


"11?  TUIS  p;jj?ICUI^AR  RfJSPOMSIEItlSTr 
I  CONSIDER  THE  AIDE'S  CDJERAL 


li. 

excellent 


'  "PEIlFORI-'ulIJCS  TO  EE. . . 

i;- 

1 

1  1 

^.  pool" 

1  fair 

1  good  1 

.(checl:  [^3  one 

I  3 

[  J 


The  teacher  checks  one  of  the  four  boxes,  thereby  indicating  her  rating  of 
the  aide's  performance  regarding  thcit  particular  responsibility.    If,  for 
exanrple,  she  vere  to  check  box  number  3  (as  illustrated  above),  she  vould 
be  stating  that  in  this  particular  responsibility  she  considers  the  aide's 
general  perfon-iance  to  be  "good." 

The  teacher  proceeds  to  the  second  aide  responsibility,  "Helping 
prepare  and  serve  the  children's  food,"  and  the  saae  statement  (regarding 
the  aide's  .eneral  performance)  is  given  in  conjunction  vith  the  responsi- 
bility.   The  teacher  continues  throagh  all  the  tventy  aide  responsibilities, 
checking  box  1,.  2,  3,  or  h.    Her  tventy  box  scores  taken  in  order,  conrprise 
the  "rol3  fulfillment  battery." 

The  teacher  role  fulfirbnent  battery  is  a  list  of  tventy  scores,  the 
result  of  a  teacher's  checking  of  one  box  after  another  for  one  run-through 
of  the  tventy  aide  responsibilities.    Each  one  of  the  tventy  scores  is  a 
1,  2,  3,  or  U.    This  role  fulfillment  battery  is  utilized  directly  to  measure 
teacher  aide  role  fulfirbnent.    The  tventy  scores  on  the  role  fulfillment 
battery  are  summed,  yielding  a  total  score  that  can  range  from  20  to  80. 

(Operational  definition:    F  =  rOle  fulfillment) 
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vhere       =  role  fulfillment  battery  resijonse  for  item  nurnber  1;  ±2  =  role 
fulfillment  battery  rcsponoe  for  item  number  2;  etc. 

Measurinfy  role  acquisition.    VJith  measures  of  role  learning,  role 
acceptance,  and  role  lulfillincnt  established,  it  is  possible  to  measure  role 
acquisition  by  an  individual  teacher  aide.    Role  acquisition  is  held  to  be 
a  suramative  score  emr^loyin'^  all  tliree  of  the  components  described  above- 
each  veighted  equally.    The  first  tvo  components,  role  learning  and  role 
acceptance,  may  be  directly  utilized  as  they  have  been  operationally  defined. 
The  third,  role  fulfillment,  requires  tvo  simple  transformations  to  meet  the 
requiremer.c  of  equal  veighting. 

First,  it  vill  be  remembered  that  the  role  fulfillment  battery  is 
derived  from  a  tventy  item  instrument,  vhereas  the  other  tvo  batteries  are 
derived  from  forty  item  instruments.    This  handicaps  role  fulfillment, 
limiting  it  to  half  the  score-building  pover  of  each  of  the  other  tvo  com*- 
ponents.    Therefore,  role  fulfillment  (F)  is  multiplied  by  2  (=2F).  Second, 
the  role  fulfillment  battery  consists  of  tventy  scores  of  1,  2,  3^  or  h; 
vhereas  the  other  tvo  batteries  consist  of  scores  of  0,  1,  2,  or  3«    The  need 
to  reduce  each  role  fu].f illinent  battery  resjjonse  by  1  may  be  expressed  by 
reducing  F  by  20  (F-20). 

Therefore,  utilizing  role  learning  and  role  acceptance  as  derived, 
and  'itilizing  role  fulfillment  as  derived  and  transformed,  this  study 
employs  the  folloving  formula  to  measure  role  acquisition  by  an  individual 
teacher  aide  in  a  Head  Start  Center: 

R  =  L  +  A  +  2(F  -  20) 
(Operational  definition:    R  =  role  acquisition) 

Uses  of  the'Role  Acquisition  Measure 

The  Role  Acquisition  Measure  vas  utilized  by  the  author  in  a 
recent  study  to  evaluate  the  effectiveness  of  Head  Start  centers  as 
aide  role-facilitating  work  settings.    The  study  atteK5)ted  to  explore 
the  relaxvcnship  between  extent  of  aide  role  acquisition  and  in-center 
role-facilitative  organizational  activities.    Activities  were  of  two 
kinds:  supervisor  (i.e.  intra-dyadic)  activities  and  center  (i.e. 
extra-dyadic)  activities.    Supervisor  activities  (12  in  all)  included 
participation  in  ti-aining  and/or  continuing  education  designed  to  help 
the  teacher  understand  her  role  vis-a-vis  the  teacher  aide;  estab- 
lishment of  j^egular  occasions  for  processing  of  routine  work  experience 
with  the  aide;    establishment  of  regular  classroom  activities  plan- 
ning procedures  with  the  aide;  and  the  like.    Center  activities  (17  in 
all)  included  sponsorship  of  workshops  to  examine  responsibilities  of 
of  teacher  aides;  provision  of  pre-servicc  and/or  in-service  training 
for  aides;  provision  of  a  career  development  plan;  and  the  like. 
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The  study  called  for  the  utilization  of  the  Role  Acquisition 
Measure's  four  instruments  with  75  teacher  -  teacher  aide  dyads  from 
19  different  Head  Start  centers.    In  the  process  of  this  study  it  was 
possible  to  obtain  some  indication  of  both  the  reliability  and  the 
validity  of  the  instruments.    Reliability  estimates  for  the  separate 
measures  of  role  learning  (l),  role  acceptance  (A),  and  role  fulfill- 
ment (F),  were  calculated  by  Hoyt  and  Stunkard's  analysis  of  variance 
procedure  (l5).    Reliability  estimates  were  as  follows: 


Measure 

Role  Learning  (l) 
Role  Acceptance  (A) 
Role  Fulfillment  (F) 
L  +  A  +  F 


Number 
of  Items 


ho 
ko 
20 
100 


Number  of 
Respondents 
(Dyads) 


75 
75 
75 
75 


Reliability 
Coefficient- 


.779 
.900 
.897 
•  539 


Scores  from  the  above  three  measures  were  also  subjected  to 
correlation  analysis,  utilizing  the  Pearson  Product-Moment  Correlation 
plus  the  Spearman-Brovm  Correction  using  z-scores.    Results  were  as 
follows : 

L  +  A  =  .668 
L  +  F  =  .1|97 
A  +  F  =  .295 


Several  findings  of  the  study  point  to  the  validity  of  the 
instruments.    It  was  found  that  there  was  a  high  positive  correlation 
between  aide    ole  acquisition  and  tenure  of  the  aide,  tenure  of  the 
teacher,  and  i^enure  of  the  dyad.    Aides  v;ho  had  held  the  teacher  aide 
position  longer  scored  higher  on  the  Role  Acquisition  Measure.  Likewise 
aides  whose  teachers         had  been  supervising  aides  longer  scored 
higher.    And  aides  who  had  been  working  with  their  teachers  longer  also 
scored  higher.    It  was  also  found  that  aides  who  worked  in  centers  that 
exhibited  a  larger  number  of  supervisor  and  center  activities  (high 
role-facilitative  environments)  scored  significantly  higher  on  the  Role 
Acquisition  Measure. 
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In  this  sajne  study  aide  scores  ranged  from  a  high  of  3^6  to  a 
low  of  211.    Scores  were  distributed  as  follows: 


Role  Acquisition  Nuiriber  of 


Scores 

Teacher 

31*6-350 

1 

331-31*^ 

3 

316-350 

10 

301-315 

19 

286-300 

19 

271-285 

13 

256-270 

5 

251-255 

0 

226-2l»0 

2 

211-225 

_3 

75 

There  are  obviously  many  research  questions  that  might  be 
explored  on  the  basis  of  teacher  aide  and  teacher  responses  on  the 
Role  Acquisition  Measure.    An  obvious  one  regards  the  relationship 
between  the  three  variables  learning,  compliance,  and  performance. 
A  study  ic  presently  being  considered  that  voiild  investigate  lovr 
compliance  -    high  performance  aides — i.  e.  aides  who  perform  satis- 
factorily but  who  are  alienated  by  their  ovm  work  routine. 

Another  use  of  the  Measure  may  be  of  more  interest  to  the 
edult  education  practitioner:  as  a  diagnostic /training  device. 
Teacher  aide  and  teacher  respond  individually  and  without 
collaboration  to  the  Teacher  AicbQuestionnaire  and  Teacher  Questionnaire. 
Both 'are  able  to  couplet e  their  questionnaires  within  one  hour's 
time"  (it  is  actually  closer  to  one-half  hour  for  the  teacher).  So 
the  time  involved  in  administering  the  instruments  is  not  extensive. 
The  author  found  in  his  administration  of  the  instruments  that  respond- 
ents exhibited  a  great  deal  of  interest  and  curiosity  regarding  the 
outcome  of  their  responses.    In  particular  teacher  aides  were  interested 
to  know  whether  they  had  "read  their  teachers"  accurately.    In  the 
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In  the  study  described  above  all  responses  were  held  confidential. 
It  woiild  seem  possible  however  to  use  the  Role  Acquisition  Measiare 
as  a  diagnostic  device  to  identify  aides  whose  "received  roles" 
"bear  little  resemblance  to    the  expectations  their  teachers  hold  for 
them.    Findings  from  such  an  effort  might  then  serve  as  a  basis  for 
teacher  aide  —  teacher  discussion,  particularly  in  the  area  of 
clarification  of  expectations. 

Concluding  Remarks 

The  Role  Acquisition  Measure  is  a  first  attempt  to  measure 
extent  of  role  acqmsition  of  a  supervisee  by  comparing  super- 
visee and  supervisor  role  expectations  (regarding  both  learning 
and  compliance)  and  by  assessing  supervisee  performance.    At  the 
heart  of  the  measure  is  the  list  of  supervisee  tasks  (i.e.  "center 
responsibilities").    It  woiold  seem  that  task  analysis  might  be  car- 
ried out  for  any  supervisee  position  in  any  organization,  and  that  the 
same  basic  instrunents  might  be  constructed  around  such  a  new  list  of 
tasks.    At  this  point  it  would  be  necessary  to  decide  whether  the 
elements  of  l)  extent  of  involvement  —  i.e.  extent  to  which  aide  is 
to  be  involved  in  the  task;  and  2)  importance  of  the  task  —  i.e  how 
important  the  task  is  to  the  organization's  goals,  are  in  fact  key 
elements  in  a  different  role  whose  acquisition  is  being  measured. 
These  two  elements  do  seem  particulai^ly  relevant  in  the  analysis  of 
paraprofessional  -  professional  work  relationships,  foc\ising  as 
they  do  on  the  problems  of  territoriality  (to  what  extent  is  this  an 
aide  versiis  teacher  task)  and  goal-directed  activity  (how  important 
is  the  task  "to  the  accomplishment  of  the  organization's  purposes). 

It  is  hoped  that  others  involved  in  adult  education  research 
might  wish  to  investigate  the  efficacy  of  the  Role  Acquisition 
Measure  —  particularly  those  persons  involved  in  the  study  of  para- 
professionals  and  paraprofessionalization  in  human  service  organ- 
izations.   But  it  is  also  the  hope  of  the  author  that  adult  educators 
might  come  to  see  in  the  occupational  role  dilemmas  faced  by  persons 
moving  into  new  positions  in  complex  organizations  an  opportunity  for 
increased  service  by  adult  education  practitioners  and  researchers 
alike.    When  work  settings  are  seen  to  be  learning  environments; 
when    work  role  acquisition  is  seen  to  be  a  basic  kind  of  learning; 
and  when  work  supervision  is  seen  to  be  a  basic  kind  of  instruction; 
then  adult  education  may  come  to  find  a  role  for  itself  in 
"improvi.ig    the  socialization  process",  to  use  Ronald  Lippitt's 
phrase  (l6).    Change  calls  for  adaptation;  adaptation  necessitates 
education;  and  education  requires  skilled  leadership.  Adult 
educators  have  provided  such  leadership  in  ih?  past  and  may  well  be 
in  an  advantageous  position  to  provide  leadership  in  the  future  — 
if  they  can  demonstrate  that  they  are  indeed  able  to  facilitate  the 
work  role  acquisition  process  for  persons  new  to  their  positions. 
And   paraprofessionals  might  be  an  excellent  group  to  start  with. 
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Item  h  =  Sent  Role  Measure 
Item  5  =  Role  Compliance  Measure 
Item  6  =  Role  Fulfillment  Measure 
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Institutional  Change  and  the  Ghost  of  the  Past: 
Historical  Issues  in  Higher  Adult  Education 


Kathleen  R.  Pcnfield 
Rutgers  University 

A  cursury  glance  at  the  literature  of  adult  education  quickly 
revealr  how  little  attention  has  been  paid  to  its  histov.  Among 
fellow  adult  educators,  I  have  often  sensed  the  sentiment  that  his- 
tory is  a  luxury  which  we  cannot  yet  afford.     Instead,  our  erophasis 
m-st  be  up^>n  that  which  has  di-ect  implications  for  the  improycment 
of  practice  .    Yet,  without  historical  insight  how  can  v;j  know  who 
or  what  we  are,  what  has  "influenced  our  acts,  or  what  their  conse- 
quences  have  been?    We  eulogize  the  need  for  social  -juo  institution- 
al change  —  pride  ourselves  on  being  at  the  cuirrir.g  od-jO.  —  but  fall 
to  understand,  as  Veblen  did,  that:     "Institutio!is  arc  products  of 
the  past  process,  are  adopted  to  past  circunistancc3,  and  arc  there- 
fore  never  in  full  accord  v  lth  the  reqviirements  of  the  present."  (1) 

Can  we  afford  the  lurury  of  not  seeking  out  the  insights  that 
cogent  historical  ana" .  ^is  could  give  us?    While  we  expound  upon  the 
beauties  of  the  coopeiative  extension  model,  teach  in  iti.  techniques, 
and  recor-  .end  it  as  the  ideal  model  for  an  industrial  or  urban  ex- 
tension service,  can  we  ignore  evidence  that  rooperative  extension 
may  have  contributed  to  the  control  of  the  agricultur.- 1  sector  by 
powerful  agribusinesses  which  are  not  only  indifferent  to  the  con- 
sumer, but  reap  profits  off  the  abject  poverty  of  others?     (2)^ Is 
it  possible  that,  in  th.;  name  of  public  service,  our  univcrijities 
contributed  to  the  development  oi-  such  a  monster?    In  our  preoccu- 
pation with  technique  and  practice,  we  had  failed  to  consider 


functions,  ^cial  consequences,  or  poUtical  inf luen.  .'r. .     We  ha-J 
ncively  assumed  that  our  institutions  and  programs  operated  in  a 
Vacuum,  and  m  v-er  ashed  impc  tant  questions  that  might  have  jarred 
the  status  quo,  or  at  least  aired  the  dirty  linen. 

University  or  gen..-,  ul  extension  sheures  the  limelight  with  co- 
operative extension  as  the  "service"  arm  of  the  university.  Despite 
the  reams  of  literature,  after  extensively  examining  it,  I  am  con- 
vinced that  we  know  little  about  hov?  general  extension  has  functioned 
in  society,  the  difference  it  has  made  in  the  lives  of  the  individuals 
it  has  :  ervad  or  failed  to  serve,  the  iorces  and  valuoi.;  that  have- 
controlled  it  or  influenced  its  devslopment,  or  what  its  effect  has 
been  upon  higher  education  and      ciety  in  general.    While  certainly 
not  the  only  means,  good  institutional  and  social  history  wuld  con- 
tribute significantly  to  our  understanding.     T  am  convinced  that  good 
historical  research  is  crucial  to  considerations  of  purpose,  functions, 
ci:-.l  change,  as  well  as  the  setting  of  future  goals  and  the  prediction 
of  future  developments  for  higher  adult  education. 

The  History  of  Higher  Adult  Education;     The  State  of  the  Art 

As  far  as  I  cr>n  ascertain,  very  few  historians  have  researched 
the  adult  education  or  service  activities  of  American  colleges  and 
universities.    Even  within  the  history  of  higher  education,  which 
has  )een  extensively  researched,  one  rarely  finds  more  than  a  fleet- 
ing reference  to  university  extension.    One  noteworthy  exception  is 
Frederick  Rudolph's  delightful  and  insightful  history,  The  Afuerican 
College  and  Uni%^ersity  (ISf.a) .     Laurence  R.  Vcysey's  thematic 
approach  in  Th£  F.r.c.rgon>e  of  the  American  University  (1965)  is  an 
rxhaustive        cly  rf  t-'^<=  Tonf 3  i-'rirrr  icicals  vjhich  ul  t." ir.cit-^ly  aave 


way  to  structural  and  idea  lional  conformity  in  2\-n\orican  higher  ed- 
ucation,    A  commendable  undertaking,  Veysey  s  continues  to  be  the  most 
provocativ    treatment jpf  tie  public  service  function  of  the  univer- 
sity published  to  date  —  a  dubious  distir.ctior,  for  he  has  little 
competition.    Despite  his  cogent  analysis.,  in  emphasizimj  internal 
curricula  refoj.-ms  to  meet  the  needs  of     new  resident  student  pop- 
ulation rather  than  universit/  outreach  functions,  Veysc^   slights  the 
role  of  extension  services  and  land-g3;ant  institutions  in  general, 

Richard  J.'  5torr  has  been  at  tbw  forefront  in  studying  the 
relationship  betv^een  higher  edacation  and  its  publics,  starting  with 
The  Beginning  of  Graduate  Educaiior.  in  America  (1953) ,  and  "The  Public 
Conscience  of  the  University,"  in  the  Harvard  Education  Review 
{Winter,  1953),  to  Harper Vs  University;    The  Beginnings  (1966).  Also 
provocative,  particularly  regarding  the  effects  of  prof essional- 
ization  and  business  influences,        Richard  Ilofstadter  and  C.  DeWitt 
Hardy,  The  Devc lopment  and  Scope  cf  Higher  Education  in  the  United 
States  (1952) •    There  is  a  great  need  for  further  research  into  the 
interrelationships  betv^een  higher  education  and  society.    Most  his- 
tori..  IS  of  higher  education  have  iocused  on  its  internal  dimensions, 
virtually  ignoring  their  social  origins  or  consequences.  Public 
relations,  changing  relationships  betweea  the  professions;  and  the 
university,  c:s  well  as  the  latter *s  role  as  credentialor ,  are  each 
in  need  of  further  study.    Major  breakthroughs  on  the  social  effects 
of  higher  education  v/ere  The  Acadertic  Revolution  by  Christopher  Jencks 
and  David  Riesnian  '  (1968)  and  Jencks's  recent  Inequality  (1972). 

Also  noteworthy  are  the  works  of  three  social  and  educational 
critics  who  e  penetrating  analyses  provide  significant  insights  into 
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the  extension  and  service  functions  of  the  American  University.  In 
Great  /u-nerican  Universities  (1910),  Edwin  E.  Slosson,  identifying 
with  the  progressive  elements  in  higher  oriucation,  employed  anecdotal, 
statistical  and  historical  techniques  to  write  a  probi  g  survey  of 
America's  leadino    miversities  at  a  critical  time  in  their  develop- 
ment.    Twenty  years  later,  in  Universities;    American, Enn I ish  ^.njl 
German  (1930) ,  Abraham  Flexner  wrote  a  searing  criticit;.'"  of  the 
utilitarian  and  service  orientation  of  American  Mgher  education.  In 
sharp  contrast,  Th£  College  Charts  Its  Course  (1939)  by  R.  Freeman 
Hutts  is  a  more  radical,  almost  missionary  treatise  on  the  need  for 
a  service-oriented  university. 

There  is  no  history  of  the  state  university  movement  in  /Amer- 
ican higher  ed;;oation,  the  political  and  social  manif cstcitions  of 
which  still  await  probing  analysis.     Two  studies  of  land-grant 
colleges  have  been  published,  the  most  provocative  of  which  is  Earle 
D.  Ross's  Democracy's  College;     The  Land-Grant  Movement  in  the 
Formative  Stage  (1942).     Edward  DanCorth  Eddy,  Jr.,  Colleges  for  Our 
Land  and  Time;     The  Land-Grant  Idea  in  American  Kducation_{19:^7)  , 
'  carries  the  evolution  of  these  colleges  into  more  recent  times,  but 
is  less  analytical  anl  focuses  primarily  on  the  develoa-nent  of  co- 
operative extension  In  terms  of  program  expansion.    Also  relevant  to 
the  formatiun  of  cooperative  extension  is  Alfred  C.  True's  A  History 
of  Agricultural  Education  in  the  United  States,  1785-19r!5  (192S)  ,  a 
vast  compendium  of  information  which  does  chronpi'Oe  events,  but  still 
leaves  a  great  need  for  a  history  of  cooperative  extension. 

•     Institutional  histories  of  colleges  and  universities  vary  greatly 
■    in  quality,  and  few  give  attention  to  extension  type  activities  o: 
adult  education.    Yet,  for  institutional  studies  of  extension,  they 


are  important  backdrops.     Particularly  valuable  is  Merle  Curti  and 
Vernon  Carstenseh,  'The  'University  of  Wisconsin:  >A  Histoij^,  1848- 
1925,Av;hich  includes  a  penetrating  analysis  of  extension  and  ex- 
tension-type r.*tivitiGS. 

Institutional  histories  of  exteni?ion  are  also  unevei;  in  quality 
and  value.    Of ten- times,  these  are  written  by  a  member  of  the  in- 
stitution to  commemorate  a  historic  milestone.    Others  are  written 
by  doctoral  students  in  search  of  a  dissertation  topic  whose  only 
qualification  is  Liiat  they  have  no  methodological  training  whatso- 
ever.   In  either  case,  the  result  is  a  more  or  less  well-done 
chronicle  of  eVents  and,  in  general,  poor  historical  research,  devoid 
of  critical  analysis  or  interpretation.    Thus,  we  know  a  little  about 
who,  when  and  where;  but  virtually  nothing  about  why,  or  cause  and 
effect.    At  th:  ;  point,  most  historic  studies  or  accounts  will  be  of 
some  value  in  adding  to  our  understnading;  some  have  already  made 
substantial  cantributions  in  their  own  right. 

Frederick  M.  I^osentreter ' s  The  Boundaries  of  the  Camnus:  A 
Hirt03:y  of  the  University  of  Wisconsin  Extension  Division,  1885-1945 
(1357)  is  by  faif  the  best  study  of  an  extension  service  published  to 
date«       1  important  contribution,  Rosentreter *s  strength  is  in  placing 
developments .w  ^hin  the  perspective  of  state  politics  and  intel- 
lectual thought.     Personalities,  conflicts  and  issues  come  to  life, 
particularly  during  the- years  of  Reber's  administration.    His  cogent' 
analysis  of  that  period  leads  one  to  be  disappc  inted  by  his  confusing 
treatment  of  the  highly  suggestive  Snell  administration,  and  vir- 
tual inattention  to  Holt's  appointivent  and  policies.    Also  limited  is 
the  analysis;  of  Extension's  functioning  within  the  c  ontext  of  a 
multi-f ached,  stratified  society,  and  developments  within  higher 
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education.    Relationships  with  the  parent  instituion,  as  well  as  bus- 
iness and  industry,  are  often  unclear.    These  criticisms  are  Intcndsd 
primarily  to  suggest  needed  directions  for  further  studies,  for  which 
Roser.treter 's  provides  an  invaluable  base  of  insights  and  in  ormation. 
Moreover,  since  :ts  object  was  Wisconsin,  a  seminal  institution  in  the 
history  of  extension,  its  contribution  is  all  the  greater. 

Ui> fortunately,  two  other  important  institutions  in  the  history  of 
higher  ^  .^It  education,  the  University  of  Chicago  a^nd  Coliunbia,  have 
not  been  the  subjects  of  probing  histoi;ical  analysis.    John  Angiun 
Burrell's  A  History  of  Adult  Education  at  Columbia  University  (1954) 
is  a  useful  but  primarily  descriptive  work  written  as  part  of  a  bi- 
centennial history  ly  a  faculty  member  of  the  English  Department, 
facts  which  do  influence  his  approach  and  interpretation.    The  main 
works  on  the  extension  effort  at  Chicago  are  Ployd  W.  Reeves,  et.  al.. 
University  Extension  Services,  The  University  of  Chicago  Survey  (3  933) 
and  Robert  M.  Roth,  A  Conspectus  to  the  Self-Study  Project  of 
University  Collegr .  The  University  of  Chicago  (1964) .    Although  both^ 
are  valuable  sources,  neither  can  substitute  for  a  greatly  needed 
history  of  the  Chicago  movement.    As  large  private  urban  institutions 
which,  on  the  surface  at  least,  developed  along  somewhat  similar 
channels,  case  histories  of  each  would  serve  to  augment  th.>  dominant 
pictvuTG  of  extension  models  within  state  and  land-grant  institutions. 

Aside  from  the  Rosentreter  study,  even  histories  of  state  in- 
stitutions are  limited.    Russel  M.  Grumman 's  University  Extension  in 
Action  (1946)  is  a  superficial  description  of  extension  at  the 
University  of  North  Carol.v.ia  written  by  its  director.    IVo  disserta- 
tions on  sLate  extension  prograiv.s,  Keimit  King's  on  California  and 
Frank  Dee 's" on  Rutgers,  are  more  comprehensive  b  -.t  limited  tc 
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descriptive  chronicling.    A  mori.  ambitious  and  noteworthy  effort  is 
"A  Historical  Analysis  of  Non-Credit  Adult  Education  Program  De- 
velopment at  the  university  of  Georgia,  1804-1968"  by  Hilton  T. 
Bonniwell  (1969),     (3)^Although  I'm  not  sure  that  the  questioi^-;  he 
asks  are  texribly  significant,  Bonnivell's  attempt  to  discuss  all 
university  services  is  commendable,  while  his  indifference  to  polit- 
ical and  social  issues  is  disappointing.    As  is  true  of  most  of  our 
studies,  the  public,  university^ and  extension  organization  are 
treated  as  though  there  were  completfe. internal  agreement  and  uniform- 
ity. 

The  samr  Criticism  applies  to  Michael  Hyle  Jessup's  "An 
Historical  Analysis  of  the  Development  of  Selected  Areas  of  Univer- 
sity Extension  Programs  in  the  United  States,  1900-19G5,  As  Related 
in  Professional  Literature."    Yet,  focusing  upon  "univeridty  level" 
credit  and  non-credit  offerings,  Jessup's  is  a  useful  su-    --y  of 
national  trends  and  a  good  starting  place  for  the  student.    .  ox- 
tension  history.    His  use  of  secondary  source  materials  is  ext.  nsive 
but  critical  analysis  and  interpretation  are  disappointingly  lacking 
Ideological  and  political  conflicts  do  not  emerge,  differences  are 
ignored,  and  changing  social  functions  never  touched  upon.  Witness 
his  conclusion  that:  ^ 

It  would  appear  that  more  extension  programs  are  being 
offered  oach  year  to  increasingly  larger  audiences.  It 
is  therej:ore,  believed  that  university  extension  is  per- 
forming the  function  for  which  it  was  founded  —  service 
to  those  who  were. unable  to  attend  programs  offered  on 
the  campus  proper.  (4) 

One  page  later  Jessup  begins  to  discuss  extension's  increasing 
services  to  the  federal  governm.  .it, ^business,  industry  and  pro- 
fe.-.sional  groups,,  without  a  word  to  causes  or  implicacions.  Isn't 


it  time  we  began  to  ask  our^elvas  v.he8e  questions? 

A  third  dissertation  is  jotGWorthy  hare:    Anne  Prcidus,  "A 
History  of  the  Division  of  General  rducataon.  New  Ycrk  University, 
1934-1959"  (1963),   (5)    Althougi  nany  cf  the  fore'::oiiig  criticisms 
would  also  apply  to  the  Freidus  study,  she  ooes  give  us  some  gen- 
eralizations worthy  of  further  ::on55ideratiou,  particularly  that  in- 
novative success  was  dependent  .pon  autonony,  which  was  made  possible 
by  program  limitation  to  non-cr:dit  offerirgs.    Thus,  the  Division 
••did  not  have  to  serve  two  masters/'  avoid: ng  the  university  controls 
which  one  strongly  suspects  wer♦^  powerful  torcfts  elsewher-  .  Yet, 
it  does  not  seem  that  all  was  i;s  simple  as  Freidus  would  ^^ave  us 
believe;  I  am  particularly  cur:.ous  about  the  consequen::es  and  impli- 
cations of  the  extensively  documented  services  to  business  and  in- 
dustry, as  well  as  the  apparer  :  seuictionL  ujon  the  Division's 
offering  an  AA  Degree • 

Although  not  a  history,  e  natural  coDi^lement  to  the  Freidus 
Ftudy  i^  Myrtle  s.  J'^cobson^s  <ight  and  p.xy:    The  Interaction 
Between  an  Academic  Institutici  and  its  iSveninq  College  (1970) , 
which  focuses  on  the  School  of  General  Studies  at  Brooklyn  College. 
Known  for  its  innovative  apprc aches  to  credit  programming,  Jacobson 
reveals  much  of  the  storm  ben.-jath  the  calm,  documenting  the  strains 
and  institutional  forces  which  served  as  a  brake  on  the  SGS's  efforts 
for  a  uniquely  adult  program.    A  less  incisive  but  good  variation 
on  the  theme  of  intraorgai.izational  interaction  is  Edward  L.  Goebel's 
study  of  patterns  and  attitudes  at  the  Universities  of  Georgia, 
Nebraska,  Oklahoma,  and  Michigan  State,  entitled  "An  Analysis  of 
Related  Organizational  l  atterns  in  University  Adult  Education  Centners 


and  Their  Parent  Institutions:    A  Study  in  Du.-.l  Hierarchy"  (1968).  (6) 

We  do  not  have  a  general  history  of  university  extension  in  the 
United  States.    James  Creese's  The  Extension  of  University  Toaclvng 
(194  )  has  been  generally  regarded  as  such,  but,  despite  some  v;orth- 
whilc  descriptive  data,  it  is  seriously  marred  by  a  lack  of  doc- 
umentation and  superficiality.    It  is  a  nice  story  and  should  be 
reaa  accordingly.    Actually,  although  only  a  chapter,  C.  Hartley 
Grattan's  treatment  of  extension's  formative  years  in  In  Quest  o£ 
Knowledge  (1955)  is  probably  as  good  as  any  published.    In  1926  the 
Carnegie  Corporation  sponsored  The  University  Afield  by  Alfred  N. 
Hall-rQuest,  a  comprehensive  sui^ey  of  considerable  historic  value 
and,  apparently,  controversy.  (7)    Although  his  conclusions  may  be 
subject  to  question,  Hall-Quest' study  is  delightfully  suggestive, 
highly  interpretative  and  based  upon  rigorous  data  analysis.  Less 
Interesting  but  st: U  useful  is  John  R.  Morton's  survey,  Univcrrity 
Extension  in  the  United  States  (1953) .    Commissioned  by  the  National 
University  Extension  Association  (NUEA) ,  it  is  a  belabored  numbers 
survey  of  course  of :  jrings  and  iiv  tructor  credentials,  weakened  by 
a  paucity  of  meaningful  comparisons  or  interpif tations. 

Our  knowledge  about:  higher  adult  education  has  b.  )n  greatly 
tdvanccd  during  the  last  decade  and  a  half  by  the  publications  of 
the  -Center  for  the  Study  of  the  )  -beral  Education  of  Adults,  whose 
tradition  is  being  carried  on  by  Syracuse  University's  Publications 
in  Continuing  Education.    A  number  of  monogx  /cis  and  studies  have 
beci.  generated  which  are  ripe  for  integration  and  interpretation. 
For  our  purposes,  some  of  the  mo  e  interestim.  research  v;as  done  by 
James  T.  Carey,  particularly  Forms  and  Forces  in  Univerr.ity  Adult 
EduccTtion  (1961)  which  is  a  provocative  attempt  to  develop  a 


theoretical  raodel  of  extension  development.    Although  a  coinmend- 
abJ.e  step  toward  the  application  of  social  science  theory  to  the 
study  (     adult  education,  it  is  lii*ited  by  reliance  upon  questionnaire 
responses  of  administrative  officers.    In  an  interesting  follow-up 
study /in  1968  Sudershan  Kapoor  used  Carey's  findings  as  a  basis 
for  developing  criteria  which  would  be  viable  indicators  of  effective 
extension  organization.    Entitled  "A  Model  of  University  Extension 
Organizatior "  (8),  the  study  was  limited  by  a  circular  determination 
of  effectiveness,  but  balanced  by  sonie -interesting  data,  particularly 
in  the  area  of  decision-making  responsibility  and  institutional 
status. 

We  arc  rapidly  accumulating  a  large  body  of  literature  on 
higher  adult  education  which  should  be  synthesized.  beginning, 
augmented  by  a  good  bibliography,  is  Malcolm  S.  Knowlfjs's  Higher 
Adult  Edxication  in  the  United  States;    The  Current  Picture,  Trends 
a:;d  Issues  (1969) .    A  part  of  the  tradition  which  developed  that 
body  of  literature,  Knowles  does  an  excellent  job  of  summarizing 
trends,  but  does  not  bring  to  it  a  fresh  questioning  eye.  Unfor- 
tunately, the  state  of  the  art  in  history  of  adult  educ-.tion  is 
rather  bleak;  at  least  we  have  been  brought  to  the  point  where  we 
have  some  data  at  our  fingertips  and  can  begin  a  critical  examin- 
ation of  the  forces  which  have  shaped  extension  an4,  the-  masters  it 
has  served* 

The  California  Study 
Ar  Issues  and  Methodology 

•  During  the  past  year  I  cor»\:  Icted  a  history  of  University 

7ixtsn.si*.  ^  at  t)  c  Lnivc      iy  o.C  caiiforula.    (9)     Initially  my  i'-itoreBt 
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had  been  triggered  by  demands  that  the  university  serve  the  needs 
of  the  poor  and  minorities,  as  veil  as  combat  the  evils  of  urban- 
ization •    Prodded  by  upheavals  from  within  as  well  as  without,  the 
Urli  -ersity  of  California  struggled  with  the  redefinition  of  its 
responsibilities  for  public  service  and  mass  access •    In  1969  and 
1970,  All-University  Faculty  Conferences  were  devoted  to  these 
issues,  the  first  focusing  upon  possible  Univ.  .'sity  responses  to  the 
"urban  crisis'  and  the  second  recommending  new  forms  to  deal  with 
that  crisis •    The  outcome  was  a  new  concept  —  -the  ej^tended  uni- 
versity" —  a  university  redirected  to  meet  new  mandates  for  con- 
tinuing education,  part-time  degree  programs,  and  problem  solving 
in  the  community •  (10) 

I  listened  to  the  debates  and  the  "new"  proposals,  and  con- 
tinued to  be  struck  by  paradoxes:    academics  questioned  whether  the 
University  should  become  involved  in  public  service  as  though  it 
were  a  new  function;  administrators  proposed  an  extended  university 
as  though  University  Extension  did  not  exist*    I  must  admit  that 
the  conceptual  difference  ;jtween  an  extended  university  and  uni- 
ver;  ity  extension  escaped  me:    Was  another  institution  being  estab- 
lished t(;  assume  responsibility,  in  part  or  in  total,  of  Extension's 
functions?    If ,so,  why,  and  what  were  the  implications? 

Prompted  by  these  apparent  paradoxes,  I  searched  the  literature 
on  University  Extension  for  evidences  of  their  roots,  and  found 
even  the  most  recent  def ini*  ive  vrork  to  be  based  on  the  assumption 
that  the  university  had  three  functions:    teaching,  research  and 
public  service  or  extension,  the  last  of  which  was  alleged  to  be 
firmly  rooted  in  the  land-grc;nt  tradition.  (11)    But,  on  the  mean- 
ings of  public  service,  particularly  its  substance  and  object,  I 


found  little  more  than  the  assumi*tions  tiat:     (1)  the  public  was  a 
1  onolith,  and  (2)  all  that  did  net  consist  of  teaching  full-time 
resident  students  or  basic  resear.ih  was,  ipso  facto,  service. 

The  university's  alleged  seri^ice  function  has  been  widely 
alluded  to  but  scantily  substantiated.    In  part,  that  may  be  due  to 
the  lack  of  attention  paid  service  by  university  policy  makers.  As 
Laurence  Veysey  has  cryptically  commented,  "It  is  difficult  to  write 
a  history,  or  even  a  sociology,  ol  silence."  (12)    One  senses  that 
service  has  been  a  pervasive  spirit  in  higher  education;  a  spirit 
whose  substance  has  been  largely  undefined;  a  spirit  which  is  today 
in  search  of  substance.    Recently,  even  the  Carnegie  Comnision 
decided  that  it  was  necessary  to  more  clearly  define  the  university's 
service  responsibilities.  (13) 

The  hypothesis  emerged  that  service  may  not  have  been  a  distinct 
university  function  at  all,  but  r<>.ther  a  bit  of  political  rhetoric 
employed  by  university. administrators  to  legitimize  their  goals  for 
institutional  expansion;  certainly  university  public  relations  lit- 
erature is  replete  with  allusions  to  service.    If  service  was  a 
viable  goal,  I  was  curiou?  as  to  what  accommodations  or  conflicts 
had  emerged  from  housing  university  extension  within  an  institution 
that  prided  itself  on  academic  excellence.    Thus,  while  an  interest 
in  determining  the  substance,  if  any,  of  the  University's  ephemeral 
public  service  priorities  provided  the  back  drop  for  research,  in  the 
foreground  was  the  closely  related  goal  of  determining  the  forms  and 
forces  which  had  shaped  Extension's  development  at  the  University  of 
California.    This  resulted  in  an  historical  approach  which,  within 
the  relevant  social  context,  sought  to  interpret  developments  in 
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both  the  University  pro^r  and  the  Extension  Division,  with  a  focus 
upon  the  interrelationships  between  them. 

The  great  bulk  of  data  was  culled  from  primary  source  holdings  ' 
in  the  University  Archivea,  the  Bancroft  Library,  and  Administra- 
Uve  Records.    Specifically,  extensive  vse  was  made  of  the  Files  of 
the  Presidents'  Office  and  the -University  Extension  Division,  as 
well  as  the  Proceedings  of  the  Academic  Senate,  including  its 
lommitte^s  on  Educational  Policy  and  Courses  of  Instruction,  the 
Graduate  Council,  the  Board  of  Regents,  and  the  All-University 
Faculty  Conferences.'    The  writings  and  addresses  of  key  figures, 
interviews  conducted' by  tfie  Oral  History  Project,  and  personal 
interviews  with  Extension  staff  members  were  invaluable  sources 
of  data  and  insight.    Also  important  were  annual  reports  of  the 
University  Presidents  and  Extension  Directors,  as  well  as  specially 
authorized  committee  reports. 

Because  of  the  interest  in  understanding  the  University's 
posture  and  influence  on  Extension,  the  Files  of  the  Presidents' 
Office  were  a  most  important  source.    This  was  particularly  true 
in  crisis  periods,  usually  spurred  by  fiscal  difficulties,'  faculty 
demands  for  control,  or  the  need  to  appoint  a  new  Extension  head. 
" .  was  . jund  that  the  selection  of  an  extension  director  was  approached 
•h  extreme  caution  by  each  University  President  and,  in  each  in- 
.ance,  the  appointment  signalled  a  major  policy  shift  or  political 
decision.    In  1938  the  politics  were  so  strong  that,  it  took  four 
years  and  a  world  war  befote"  the  President  felt  sufficient  power  to 
mandate  the  future  thrust  of  Extension. 

Along  with  the  Presiderite '  Files,  manuscriptftcollections  and 
personal  interviews  wete  crucial  to  flushing  out  the  meaning  and 
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drama  that  lay  beneath  the  relatively  dry  and  uninteresting  annual 
reports  and  committee  meetings.    When  one  reali'/es  that  most  exten- 
sion histories  have  been  based  solely  upon  annual  reports,  one  can 
understand  vhy  they've  been  pro  -ccupied  with  reporting  growth  and 
limited  to  chronicling  events.    Interviews  were  uneven  in  value, 
depending  upon  the  interviewer Is  skill  and  the  interviewee's 
willingness  to  talk  and  accuracy  of  recall.    They  were  important  as 
indicators  of  possible  problems  or  conflicts  in 'the  early  stages, 
spurring  the  search  for  documentation. ^  Used  skillfully,  interviews, 
can  be  invaluable  tools,  but  must  be  interpreted  cautiously.  The 
same  generalizations, apply  to  the  interviews  conducted  by  the  Oral 
I.istory  Project:    some  recollections  were  incorrect,  some  inter- 
viewers did  not  ask  proving  questions,  and  some  insights  were  price- 
less. 

.    Understanding  events  in  California  Extension  depended  upon  a 
firm  knowledge  of  the  University's  history  and  governance,  national 
trends  in  higher  educatio.i-.  and  extension,  and  the  unique  factors  in 
California's  social  and  political  history.    Secondary  sources  were 
important  for  providing  this  context,  as  were  primary  f;ource  mater- 
ials from  l.he  university  and  the  Proceedings  of  the  NUEA.    'This  was 
■  particularly  important.    When  its  very  function  has  been  described 
as  a  bridge  between  the  university  and  the  public,  to  study  gener:a 
extension  as  though  it  existed  in  a  vacuum  is  sheer  folly.    This  has 
been  a  major  weakness  of  extension  research  to.  date. 

B.    Observations,  Interpretations,  and  ynf-swer'^d  Questions 

The  use  of  different  foms  of  spurce  materials  resulted  in  some 
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unexi>ected  findings.    One  of  the  most  interesting  was  that  extension 
in  California  grew  out  of  and  developed  under  fundamentally  conser- 
vative principles.    "Extension  was  originally  launched  to  raise  the 
quality  of  c0if)didates  for  the  university  and  to  make  the  public  aware 
of  its  academic  purposes.    Charles  Mills  Gay ley ^  extension's 
founder  opposed  "the  higher  edtcation  of  the  periphery and  warned 
that 

The  University  should  not  adopt  the  idols  of  the  community. 
It  should  set  the  ideals.    The  American  University  is^  and 
ever  must  be^  democratic.    It  offers  education  to  all  who 
can  profit  by  it.    But  education  itself  is  Aristocratic  — 
of  the  best  and  for  the  best.    The  educated  are  tlio^e  who^ 
having  striven,  are  the  chosen  few.  (14) 

The  maintenance  of  University  standards  was  deemed  to  be  crv:cial. 
Referring  to  the  first  group  of  experimental  students /  Gay ley  proudly 
commented  "that  only  52  out  of  1,230  listeners  have  passed  the  exam- 
inations set,  attests  to  the  grade  of  work  required  by  the  University 
of  th'.-e  who  deseri^etl  its  certificate.  "  (15) 

In  the  eai  ly  years,  one  anonymous  Extension  critic  argued  that 
the  courses  were  '•partaken  by  people  of  fashion  and  leisure,  generally 
of  the  feminine  gender^  who,  between  two  tear*,  come  to  nibble  at 
intellectual  sweetmeats."    Instead,  he  implored  the  University  to 
"be  humble,  willing,  efficious  in  it«  relations  to  the  poor  classes, 
let  its  light  seek  every  possible  avenue  into  the  lives  of • the 
lowly."  (16) 

Possibly  because  the  public  tired  of  the  "intellectual  sweet- 
iiieats"  which  the  University  saw  fit  to  offer  it.  University  Exten- 
sion followed  the  national  pattern  of  decline.    In  1912,  partly 
influenced  by  extension  successes  at  Wisconsin,  and  determined  to 
stay  the  movement  to  found  a  rival  institution  in  the  soulisern  part 
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of  the  State,  Ira  Woods  Howerth  was  recruited  from  Chicago  to  revivify 
extension.  Howerth  energetically  worked  to  establish  extension  along  the 
Wisconsin  model,  was  met  with  staunch  opposition  and  the  institution  of 
ligid  faculty  controls.  (17)  When  re  refused  to  conform,  he  was  fired.  A 
social  progressive  and  an  educational  radical,  the  University  Regents  and 
faculty  could  not  accept  Howerth's  efforts  "to  provide  broad  educational 
opportunities  for  the  people"  and  "to  make  the  University  more  broadly 
useful  to  the  people.  "  (3  8) 

The  firing  cf  Howerth  was  partially  influenced  by  his  pacifist  stance 
on  World  Wai- 1.  Other  instances  in  the  history  of  Extension  at  California, 
augmented  by  those  Rosentreter  cities  in  his  study  of  Wisconsin,  lead  to 
the  suggestion  that  alien  political  or  social  ideas  could  not  be  tolerated  in 
extension  of  all  places.  For  example,  Rosentreter  reports  that  bigoted 
public  opposition  to.S.  L  Hayakawa's  Japanese  ori0ns  and  T.  Harry  Williams's 
lectures  on  American  Kstory  led  to  the  cancellation  of  their  classes.  (19) 
Unprotected  by  tenure  or  the  walls  of  the  ivory  tower,  no  One  has  yet 
researched  the  possibly  strong  impact  of  conservative  public  opinion  up(Mi 
extension  programming. 

Howerth's  successor,  Leon  J.  Richardson,  symbolized  the  conservative 
temper  of  the  interwar  period.  A  Latin  schdar  and  respected  University 
professor,  Richardson's  duty  was  to  bring  Extension  back  into  the  fold  and 
make  it  "ti^uly  representative  of  the  University. "  This  was  accomplished  by: 
(1)  the  limitation  of- Extension  to  instructional  activities;  (2)  the  elevation  of 
offerings  to  resemble  more  closely  "university  level"  work;  (3)  the  active 
recruitment  of  University  faculty  and  academically  trained  personnel  as 
Blxtension  teachers;  and  (4)  the  institution  of  an  elaborate  system  of  University 
checks— each  Extension  offering  was  to  be  approved  by  the  Extent.:  Advisory 
Board,  the  relevant  University  department,  the  Pi'esident  of  the  University, 


and,  in  the  case  of  credit  courses,  the  Committee  on  Courses  of  Instruction. 

It  was  through  the  committee  on  Courses  and  the  university  advisory 
board  that  the  faculty  exerted  its  greatest  controls.-  When  the  faculty 
perceived  that  Extension  was  getting  out  of  hand,  it  used  its  newly  attained 
power  and  threatened  to  abolish  Extension's  right  to  offer  courses  for 
degree  credit.  Two  major  crises  were  brought  about  this  way;  the  first  in 
the  late  '20's  and  the  second  in  the  late  «50's.  fii  the  first  case.  Extension- 
was  powerless  and,  led  by  a  faculty  member  who  "understood  University 
values,  "  the  fiH^ulty  weilded  extensive  control  over  Extension  until  World 
War  IL  In  the  second  case,  a  stronger  Extension  unit  fought  vigorously, 
primari^  on  economic  grounds,  and  ultimately  won  what  may  yet  prove 
to  be  a  pyrric  victory. 

The  movement  toward  coUege-level  credit  offerings  in  the  'BO's  and 
'30's  was  a  national  one.  Daring  this  period  the  NUFA  had  a  committee 
on  standards  which  strove  to  make  sure  that  extension  offerings  were  of 
university  grade  and  attempted  to  standardize  degree  credit  values.  Hall- 
Quest's  study  in  1926  pointed  to  the  coming  transition  in  extension;  the 
transition  from  tlie  ideal  of  serving  the  people's  needs  wherever  and  however 
manifest,  to  an  emphasis  upon  university  instruction  for  those  unable  to 
attend  full-time.  .  • 

It  is  interesting  that  extension  was  dominated  by  the  service  ideal, 
populaiiy  known  as  the  Wisconsin  Idea,  for  less  than  a  decade.  World  War  I 
spelled  the  end  of  that  Utopian  period.-  War-time  needs  and  returning  veterans 
created  new  demands  for  university  instruction  which  extension  was  asked  to 
fill.  Searching  for  legitiiiiacy,  extension  leaders  willingly  followed  the  call, 
especially  when  it  .came  from  men  of  the  stature  of  Nicholas  Murray  Butler, 
Edward  L.  Ihorndike  and  Frederick  P.  Keppel,  and  was  reinforced  by 
Carnegie  tar-us  which  m:  ie  possible  the  initial  steps  of  a  drive  toward  pro- 
fess'oni^'zal' or 


Individual  demands  for  instruction  from  middle  class  members  of 
newly  emerging  professions  were  paramount  during  the  interwar  period. 
When  new  institutions  threatened  to  compete  for  the  university's  clientele, 
ejctension  centers,  evening  colleges  and  even  full-fledged  junior  colleges 
were  established  by  imlversities,  thereby  enabling  them  to  maintain  control 
over  higher  education  in  their  vacinlty.  Thus,  extension  became  firmly 
established  as  a  teaching  arm  of  the  university  and  emeshed  in  the  degree- 
granting  process.  The  California  case  suggests  that  this  trend  was  rein- 
forced by  faculty  membcfrs  who.  anxious  tq  improve  their  economic  status, 
saw  extension  teaching  as  an  opporfame  way  to  make  extra  money.  During 
the  depression  years  the  faculty  even  passed  rules  which  virtually  pro- 
hibited any  but  their  own,  ranks  from  teaching  in  Extension.  In  later  years 
much  more  lucrative  consulting  opportunities  would  take  Extension's  place 
as  tlie  desired  income  supplement. 

Entrepreneurial  motives  were  not  limited  to  the  faculty.  As 
extensionists  becam§  more  sophisticated  they  too  became  skilled  entre- 
preneurs. This  was  particularly  true  in  the  period  following  World  War  XL 
Out  of  the  defense  programs  came  strong  ties  with  the  military,  business 
and  industry,  and  with  them,  economic  prosperity.  Service  went  unequivocally 
to  those  who  had  the  money.  In  California,  Baldwin  Woods,  a  professor  oi 
engineering,  was  appointed  head  of  extension  and,  synibolizing  its  new  importance, 
subs.cG[uently  named  a  Vice-President  of  the  University.  For  a  while,  influential 
ties  and  the  status  of  Baldwin  Woods  gave  considerable  power  within  the 
universfiy;  it  prospered,  and  nary  a  squeak  was  uttered  about  university 
standards  or  purposes. 

The  era  of  good  feelings  ended  abruptly  with  the  change  in  University, 
Extension  and  State  Government  administrations.  .The  reasons  are  many  and 
too  complex  for  the  scope  of  this  paper.  (20)  However,  one  interesting 
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hypothesis  that  emerges  Is  the  possibility  that,  as  core  of  the  University 
began  to  develop  programs  in  areas  of  extension  activity,  it  raised  the  red 
herring  of  standards,  or  extension's  competence  to  function  in  that  area. 
This  appears  to  have  been  true  with  engineering,  education  and  business. 
More  recently,  in  a  period  of  fiscal  crisis  and  declining  enrollments,  the 
universi^  is  talking  about  adopting  "non-traditional"  forms  of  education  •  . 
and  suggesting  tliat  extension  does  not  have  the  proper  resources  to  function 
in  this  area. 

Research  on  the  California  case  reve?Qed  that  University  controls  over 
Extension  have  been  manifest  through  administrative  and  faculty  power  over 
appointments  and  promotions,  the  University  committee  structure,  and  a 
faculty  advisory  board.  The  faculty's  greatest  source  of  power  has  been  in 
ih'  control  over  degree  credit,  an  area  in  which  it  reins  supreme.  For 
example,  the  California  credit  controversy  of  the  '60's  revealed  that,  even 
though  Extension  technically  had  the  right  to  grant  degree  credit,  degree 
requirements  were  so  prescribed,  both  formally  and  informally,  that  accep- 
tance of  extension-earned  credit  for  degrees  was  extremely  limited.  (21) 
In  comparison,  Extension  had  no  base  of  power  within  the  University;  the 
closest  it  came  was  through  ties  with  influential  members  of  the  public, 
and  being  able  to  show  how  important  its  existence  was  tc  the  well-being 
of  the  University. 

In  California,  Extension  was  not  a  top  University  priority;  when  it  was, 

its  value  was  perceived  as  instrumental  to  the  realization  of  autonomous 

University  goals.  Extension  variously  served  the  University  in  political  and 

> 

public  relations  capacities;  it 'was  used  to  stay  movements  for  rival  institutions 
by  accommodating  popular  demands  for  access  to  the  University.  In  the  pro- 
cess, it  acted  as  a  buffer,  protecting  the  University's  basic  research,  teaching 


^  sdiolafly  functions  fronl  public  onslaught,  •  ironically,  despite  die  fact 
th-^t  t!ie  most  devastating  chaiye  levied  against  tortension  was  that  its 
^academic  standards  were  inherently  inferior,  Extension  h'ay  acfriilly  have 
•enabled  the  University  to  maintain  its  elite  standards.  It  has  be^n  an 
important  means  by  which  the  University  could  perform  both  el.te  and 
popular  functions.  ■  ' 

Hie  California  case  reve&ls  that  service  was  not  a  discrete  University . 
goal.  Bases  of  legitimacy  withiii  the  University  were  not  shift€d  in  order  . 
to  accommodate  social  needs;  these  were  tolerated  only  '.f  they  would  not 
endanger  academic  goajs.  The  overwhelming  evidence  is  that  :;ervice  was 
considered  a  by-product  of  regular  teaching  and  research,  and  University 
policies  were  unaffected  by  social  value  or  utility.  Service  was  rarely 
even  alluded  to;  when  it  was*  relevant  University  activities  were  listed  in 
order  to  legitimize  the  University  as  a  recipient  of  public  spending.  Signifi- 
cantly, even  when  service  vtas  referred  to,  Extension  was  not  considered 
in  that  light  until  the  postwar  era.  Instead,  Extension  was  fcleaily  identified 
as  a  teaching  division  and,  in  that  sense  only,  ftmctloned  as  a  popular  arm 
x)i  the  University. 

This  suggests  that  a  viable  land-grant  tradition  did  not  exist,  except 
as  It  may  have  thrived  in  the  College  of  Agriculture,  and  even  that  is  subject 
to  question.  The  main  core  of  the  University  has  stniggled  to  remain  unaf- 
fected by  popular  mandates,  begrudgingly  accepting  such  OQly  when  they  have 
been  foisted  upon  it.  Ihe  admlnlstrs^on  has  been  more  aware  oit  ihe  necessity 
that  the  University  be  relevant  to  society,  particularly  in  terms  of  its  importance 
for  public  support.  Th»^  main  source  of  res^tance  has  been  the  faculty  which 
has  refused  to  evgJuate  Service  positively  in  considering  program  success  or 
professorial  promotion. ' 


Despite  the  current  tendency  to  legitimize  social  responsibilities 
in  terms  of  the  land-grant  tradition,  the  notion  of  service  as  a  separate, 
legitimate  University  function  is  a  relatively  new  one.  In  California, 
except  for  the  Howerth  period,  even  Extension  did  not  seek  to  legitimize 
its  programs  in  terms  of  public  service  until  the  latter  part  of  the  1950's, 
a  good  five  years  before  the  University  began  to  ponder  social  responsibilities. 
'  'Tliat  search  was  a  response  to  public  clamor  and  outside  funding,  the  most 
Important  source  of  which  was  mandated  by  the  1065  Higher  Education  Act. 

•  •  • 

At  .the  University  of  California,  President  Ifltch  has  encouraged  the 
exploration  of  way.':-  In  which  the  University  might  apply  its  resources  to 
community  problem  solving,  and  serve  a  wider  clientele  by  opening  up  part- 
time  degree  possibilities.  To  what  extent  this  concern  for  meeting  public 
needs  is  a  manifestation  of  the  need  to  win  public  support  at  a  low  point  in  the 
University's  history  remains  to  be  seen;  nonetheless,  service  possibilities 
are  being  pursued  at  the  University  with  an  unprecedented  Enthusiasm. 

Enthusiasm  and  good  will,  however,  have  yet  to  result  in  substantive 
changes  in  University  priorities  or  policies;  there  has  not  been  reallocation 
of  funding,  promotional  policies  continue  toetnihasize  research  and  publication, 
the  forms  necessary  for  the  articulation  and  focus  of  University  resources  have 
not  been  implemented,  and  values  do  not  appear  to  have  changed  significantly. 
The  faculty  continues  to  emphasize  that  "the  eminence  of  any  great*  University 
lies  in  its  relatively  detached  perspective  and  in  its  freedom  to  pursue  know- 
ledge and  truth  for  their  own  sakes. "  (22) 

The  ascendance  of  profcssionalizs^tion  has  been  one  ol  the  most  pervasive 
influences  upon  Extension's  development.  Its  effect  has  been  threefold:  (1)  the 
mushrooming  of  new  clientele  groups  with  needs  for  credentialing,  upgrading 
and  updating;  (2)  the  rise  of  the  academic  profession  as  a  potent  force  in 
University  policy  determination;  and  (3)  the  emergence  of  adult  education  as  • 
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a  specialized  area  of  expertise  and  professional  identity.  The  California 
case  suggests  that  while  the  professionalization  of  adult  education  served  to 
endowExtension  work  with  a  degree  of  sophistication,  it  also  contributed  . 
to  conflict  within  the  University  as  allegiance  to  the  pracUcal  imperatives 
of  adult  education  clashed  with  academic  values. 

Our  knowledge  about  professionalization's  consequences  is  still  liniited, 
but  there  is  reason  to  believe  that,  in  spile  of  the  rhetoric  about  clit-lele 
service,  it  may  have  instead  encouraged  bureaucratic  forms  and  a  pre- 
^       occupation  with  status  which  may  instead  hive  driven  a  wedge  between  the 

professional  and  the  client.  (23)  There  are  traces  of  this  in  Extension  where 
one  notes  the  development  of  large  professional  staffs,  new  experts  preoccupied 
with  craft,  sophisticated  techniques  and  "high  quality"  programs  rather  than 
a  direct  "rubbing  of  the  elbows"  with  the  client.  (24)  And  so  continuing  education 
replaced  adult  education,  and  powerful  interests  rather  than  the  "little  man" 
received  the  focus  of  our  attention. 

The  standards  issue  appears  to  have  been  closely  tied  to  the  professional 
drives  for  status  by  the  academic  man  who  sought  to  control  the  licensing  of 
!       his  f&Uow  professionals  and  to  monopolize  the  right  to  practice  "higher 
education"  or  the  granting  of  degrees  and  credentials.  As  the  academic 
market  place  becomes  tighter,  one  can  anticipate  that  the  drive  to  remove 
extension  from  the  degree-credit  area  will  intensify.  On  the  other  hand, 
still  seeking  acceptance  within  the  University  community,  as  well  as  a  stable 
clientele  and  support  base,  extensionists  will  most  likely  seek  new  areas  for 
credit-granting;  they  will  probably  succeed  through  the  institutionalization  of 
compulsory  continuing  education,  measured  through  a  new  form  of  credit,  the 
continuing  education  unit  (CEU). 

It  is  ironic  that  precisely  at  that  juncture  in  history  when  universities 
ERIC  ropsiderlng  alter:  ative  forms.,  extension  is  talking  cf  standardization 
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through  CEU's.  Ttie  irony  would  be  more  complete  If  the  alternative  forms, 
when  implemented,  were  truly  "nontradiUonal. "  To  do  so,  they  must  either 
.escape  control  by  traditional  academic  "alues,  as  has  been  demonstrated 
by  the  Extension  experience,  or  academic  values  mils':  change.  External 
pressure  may  yet  cause  tliat  to  happen;  \when  and  U  it  does,  chances  are 
.that  adult  educators  will  be  left  behind,  as  has  already  happened  in  several  • 
experimental  endeavors,  one  case  in  print  being  California's  Extended 
University. 

Perhaps  our  being  left. behind  is  legitimate.  History  indicates  that  we've 
not  been  as  innwraUve  as  we'd  like  to  think.  Thus,  in  response  to  the  argu- 
ment that  adult  educators  have  been  imrolved  in  nontradiUonal  study  for 
some  Ume,  Samuel  B.  Gould,  head  of  the  Commission  on  NontradiUonal 

Study,  agrees  that 

there  is  some  validity  in  this  argument,  since  the  statistics 
of  continuing  education  look  impressive  and  tlie  achelvements 
seem  significant.  The  trouble  is  that  the  public  wants  much 
more  tiian  is  currently  offered,  wants  it  in  a  differeni  and 
more  flexible  style,  and  contains  large  segments  which  have 
thus  far  been  served  very  Uttle,  if  at  all,  by  continuing 
education.  @5) 

Gould's  statement  is- probably  true.  While  we  may  haire  made  some  headway 
in  understanding  why,  more  questions  than  answers  confront  us  as  we  try  to 
unlock  ti:3  past  and  understand  the  present.  My  historical  research  on 
California  suggests  that  the  past  may  not  have  been  as  pleasant  a:;  we'd  111» 
to  believe.  Further  research  is  needed  to  substantiate  or  refute  some  of 
the  generalizations  emerging  from  that  study.  Most  important,  -.ve  must  begin 
the  probing  analyses  that  will  enable  us  to  understand  how  we  have  functioned 
within  society  and  the  forces  that  have  driven  us  to  function  accordingly.  Only 
then  can  we  hope  to  control  our  future. 
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2. 


PROBLEMATIQUE  ET  OBJET  DE  LA  RECHERCHE 


1.1    Problematlque  d' Education  Permanente  qui  reraet  en  caupe  organisa- 
tion unlversltalre  tant  : 

•  de  1* education  de  jeunes 

•  que  de  P education  des  adultes. 

1-2    Oblet  de  la  recherche  :  Le  Service  d' Education  Permanente  (S.E.P.) 
de  I'Unlverslte  de  Montreal,  pour  en  degager  I'apport,  comme  orga- 
nisation, k  la  construction  d'une  Universlte  d' Education  Permanente, 
entendue  comme  une  universlte  capable  de  repondre  aux  deraandes  edu- 
catlves  de  groupes  soclaux,  dlfferencles  par  leur  appartenance  tant 
aux  classes  soclales  qu*aux  classes  d'age. 

•  Justification  du  cholx  de  I'objet  :  Le  S.E.P.,  par  la  necesslte  de 
rejolndre  de  nouveaux  groupes  soclaux,  vlt  un  processus  de  dlffe- 
renclatlon  de  1 ' organisation  unlversltalre  classlque. 

Ce  processus  de  dlf ferenclatlon  s'opere  prlnclpalement  par  deux 
moyens  : 

1-  des  sous-commlsslons  d'etudes 

2-  des  systemes  de  programmatlon 

•  L.'hvpothe8e  est  que  ce  processus  de  dlff erenclatlon  esqulsse  un  nou- 
veau  modele  organlsatlonnel  concemant  1 '  organisation  de  la  relation 
unl versl te-environnement . 


3. 


2 


LOCALISATION  DE  L'OBJErT  DE  RECHERCHE 


2.1    Hlstorlque  et  8l*tuatton  du  S.E.P. 
•    1952  Service  d' Extension   


1968 

J 


S^E.P. 


-  une -credltatlon  des  programmes  de  formation  (Certlfl- 
cats)  done  liaison  academlque  renforc^e 

-  un  developpement  original  des  programmes  et  des  syat^raes 
de  programroation* 

Annee  71-72        ^  23  certificats  -  4106  etudiants  - 

275  professeurs  -  16  responsables  de 
programme . 


•    Cependant  situation  mareinale 
par  rapport  a  1' organisation 
universitaire 


•  Juridiction  limitee  du  SEP  sur 
les  Certificats  (elaboration-pro- 
gramme ) ; 

•  Difficulte  de  passage  au  2erae  et 
3ime  cycle; 

•  Statut  officiel  insatisfaiaant 
pour  les  responsables; 

•  Pas  de  corps  professoral  permanent, 


2.2    Importance  pour  la  recherche  d'analvser  son  oblet  (le  S,E,P,)  dans  : 

1-  sa  situation  de  mar&inalit^  :  le  SEP  est  apparu  et  se  developpe 
a^TRE  I'Universite  et  de  nouvelles  clienteles  :  un  role  de  relais; 


2-  son  developpement  hlstorlque  :  des  elements  de  relals  se  so 
ajoutes  les  uns  apres  les  autres  et  leur  ensemble  tend  a  se 
dlfferencler «gtuellement  comme  systems  social  organise. 

  S.E.P. 


2»3  Importance  aussl  de  sltuer  ces  trols  ensembles  (Unlverslte-S, - 
Nouvelles  Clienteles)  dans  I'ensemble  plus  vaste  qui  les  englobe  : 
1' ensemble  soclo-culturel ,    Le  tout  peut  se  vlsualiser  alnsl  : 


S.E.P. 

Unlverslte  11                      t  " 



/     ^  Nouvelles 

1  ' 

Y    ^  clienteles 

Ensemble  soclo-culturel 

Le  module  d* analyse  devra  done  pouvolr  rendre  compte  des  elements 
et  des  relations  : 

1/  de  I'ensemble  soclo-culturel  dans  sa  globallte; 
2/  des  trols  sous-ensembles  (Unlverslte-SEP-Nouvelles  clienteles); 
3/  de  1' interaction  entre  Q    et    Q  ,  c«est-&-dlre  de  1' Interac- 
tion entre  un  ensemble  soclo-culturel  et  un  ensemble  educatlf • 
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LE  MODELE  DU  CIRCUIT  DE  CX)NNAISSANCE  DE 
R>  G>  HAVELOCK  * 
3.1    Presentation  Renerale 

K.  G.  Havelock  caract^rlse  I' ensemble  soclo-culturel  de  fa^on  dy- 

namlque  coinme  un  circuit  permettant  un  transfert  de  connaissance  entre  un 

syst^rae  ressource  et  un  systeme  client.      Le  transfert  peut  s'operer  k 

quatre  niveaux  :  individuel,  interpersonnel ,  organisationnel  et  inter-or- 

ganisationnel.  Les  systeraes  ressource  et  client  sont.suivant  les  niveaux, 
soit  : 

-  un  sous- systeme  de  la  personne,  vue  coraroe  generatrlce  de  probleraes 
et  de  solutions; 

»  une  personne; 

-  une  organisation; 

»  plusleurs  organisations. 

Le  systeme  client  est  le  destinataire  ultime  de  la  connaissance  : 
c'est  lul  qui  lul  donne  sa  raison  d'etre.    II  joue  prlncipalement  un  role 
d'utilisateur.      Pour  repondre  aux  demandes  du  systeme  client,  le  systeme 
ressource  doit  se  diversifier  et  se  repartir  differents  roles.  Havelock 
distingue  trois  roles  fondamentaux  :  un  role  de  recherche  fondamentale 
(Production  de  connaiss&nce  sans  reference  a  ses  applications  possibles), 
un  role  de  recherche -developpement  (Production  de  connaissance  explicite- 
ment  en  vue  d'une  application),  un  role  d' application    (Diffusion  de  con- 
naissance sous  forme  de  produits  et/ou  de  services), 

Au  niveau  inter-organisationnel ,  ces  roles  tendent  a  etre  joues  par 
des  organisations  dlff ^rentes*    Un  problems  complexe  d* articulation  fle  pose 

^    Ronald  G.  Havelock,  Planning  for  innovation  through  Dissemination 

and  Uti ligation  of  Knowledi>e>  Center  for  Research  on  Utilization 
of  Scientific  Knowledge,  University  of  Michigan,  Ann  Arbor, 
Michigan,  1971. 
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done  pour  que  le  circuit  macro-social  de  connalssance  fonctlonne  au  pro- 
fit du  systeroecllent  represente  par  la  masse  desconsomraateurs.  Souvent 
ce  sont  les  Iraperatlfs  da's' organisations  de  recherche  ou  d' application 
(Industries,  services)  qui  d^Jterralnent  le  circuit  de  connalssance,  au 
detriment  du  systeme  client,    Certalnes  organisations  (gouvemeraent ,  mass 
ra^dla)  peuvent  jouer  un  role  de  correcteur  et  de  regulateur.      Mais  la  com- 
plexlte  actuelle  est  telle  que  Havelock  note  I'apparltlon  d'un  clnquleroe 
role  dans  ce  circuit  :  role  de  couplage  (linkage)  joue  de  fa^on  teraporalre, 
mals  tendant  a  devenlr  permanentB ,  par  des  Indlvldus  ou  des  organlsraes  spe- 
cialises. 

Les  scheraas  sulvants    vlsualisent    les  Inter-connexlons  des  roles 
et  donnent  une  representation  approchee  des  Inter-connexions  entre  les 
organisations  qui  jouent  ces  roles. 


3  •  2      Inter ''Connexion  des  roles 

Le  schema  1  indlque  Idealement  toutes  les  connexions  possibles  en- 
tre les  roles  san    tenlr  compte  des  dlfferentes  barrleres  plus  ou  molns  for- 
tes   qul,concrfetement,  existent  dans  les  Interfaces.      Le  schema  2  veut  te- 
nlr compte  de  ces  barrleres  et  presente  en  traits  plelns  les  connexions  cen- 
trales et  en  polntllles  les  connexions  marglnales  :  les  connexions  centrales 
s'effectuent  de  fa^on  unl forme;  ce  qui  veut  dire  par  exemple  que  les  messa- 
ges Issus  du  monde  de  l« utilisation  passent  le  plus  souvent  par  le  crlble 
du  monde  de  la  pratique  et  n'arrlvent  que  transformes  au  monde  de  la  recher- 
che. 
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Scheoa_l  :      MODELE  IDEAL  DE  L' INTER-CONNEXION  EUTRE  LES  ROLES  DU  MACRO. 

SYSTEMS  DU  FLUX  DE  OONNAISSANCR  (Tire  de  R.  G.  Have lock, 
op.  cite,  p.  3-4). 
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3.3      Inter-connexlons  des  organisations 

Le  schema  2  suggere  comment  les  dlfferents  roles  s'artlculent  ac- 
tuellement  dans  un  ensemble  sc^io-culturel  occidental  typlque.    Le  schema 
3  pr^iente  plus  concreteroent  un  tableau  des  organisations  qui  jouent  ces 
roles  sulvant  cette  structure. 

1-  a  droite,  se  trouve  le  sous-systeme  le  plus  grand  et  le  plus  dlffus, 
celul  des  utlllsateurs  de  la  connaissance  (clients,  patients, 
etudlants,  ...)•      Blen  que  ce  sou8<-8y8t^me  soit  le  receveur  et  le 
b^neflclalre  ultima  du  raacro-systeme,  c'est  lul  qui  est  le  raolns  or- 
ganist et  le  molns  Influent.      11  peut  naturel lament  Influencer  les 
autres  sous-systeroes  par  aes  deroandes  et,  en  dtmocratie,  par  aes  re- 
presentants  elus  au  gouvemement.      Mais  malgrt  tout  il  re5olt  plus 
d' inputs qu'il  n'en  donne.      Les  inputs viennent  soit  des  organismes 
de  services (hopital,  ecole,...),  soit  des  entreprises,  soit  dlrecte- 
ment  des  professions  (psychologues,  ...),  ou  encore  des  media.  Ces 
sous-systeroes  sont  done  les  premiers  mec^.iismes  de  couplage  entre  les 
utlllsateurs  et  les  experts  du  monde  de  la  recherche. 

2-  Les  professions  jouent  «n  plus  un  role  essentiel  de  couplage 
entre  le  monde  de  la  recherche  et  les  organismes  de  services  et  de 
production.    Dans  quelques  secteurs,  les  professions  joignent  direc- 
teroent  les  utilisateurs,  indtpendamment  des   organismes  mentionnes; 
c'est  le  cas  des  juristes  et  parfois  des  medecins.    En  education, 

ces  services  professionnels  directs  etaient  le  modele  avant  que  Platon 
fonde  I'Academie,  mais  actual lement  lis  sont  rares. 
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3-  La  soclete  sclentlflque  chevauche  les  professions  et  Tunl- 
verslte.    Have lock  precise  qu'ellc   tend  plus  a  se  rapprocher  des 
departements  a  I'lnterleur  de  I'unlverslte  que  des  organlsme  de 
services et  de  production. 

4-  L'Unlverslte  comrae  un  tout  foumlt  une  large  ombrelle  Ins- 
tltutlonnelle  a  une  grande  varlete  d« experts.    Pour  chaque  champ 
de  recherche,  I'unlverslte  est  la  place  ou  les  experts  se  sentent 
Chez  eux.    Aussl  la  verrons-nous  comne  un  sous^systeme  geant  ayant 
une  Importance  prlmordlale  dans  le  macro-systeme  de  connaissance. 

5-  Les  m^dla  representent  un  canal  direct  de  diffusion  entre 
les  chercheurs  et  les  pratlclens  de  toutes  sortes  et  la  grande  raa- 
jorlte  des  consommateurs.    Aussl  sont-lls  souvent  utilise  pour  pas- 
ser par-dessus  les  organlsraes  habltuels. 
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Inter-connexlons  des  orRanisroes  specialises  de  couplage 

Dans  le  schema  3,  I'unlverslte  est  vue  comme  jouant  prlnclpalement 
un  role  de  production  des  connalssances  (Recherche  fondaroentale  et  Recher- 
che Appllquee),  et  un  role  de  diffusion  par  le  cana'  du  sous-systiroe  des 
professions  entl^r^iinent  constitutes    (professions  Ubtrales  :  droit,  mede- 
cine,  art,   enselgnement ,  et  professions  technlco-sclentlf Iques  :  Ingenleurs). 
Les  Inter-relations  entre  I'ensemble  4ducatlf  reprisente  par  I'unlverslti 
et  I'ensemble  soclo-culturel  represents  par  les  autre  elements  du  schema 
ne  posent  pas  da  problcroe  tant  que  les  demandes  Sducatlves  auxquelles  1' univer- 
sity repond  proviennent  des  professions  entlerement  constltuees* 

(^pendant  cette  liaison  privilegiee  fait  ecran  entre  I'unlverslte 
et  d'autres  demandes  pouvant  venir  solt  de  professions  emergentes  (semi- 
professions)  >  soit  dlrectement  du  monde  des  "utlllsateurs"  de  la  connals- 
sance^ non-engages  dans  un  systime  professionnel  :  vieillards  ou  adultes 
se  regroupant  dans  differentes  associations  de  consommateurs  (locatalres, 
acheterrs,  etudlants,  malades,  prisonnlers,  ...),      La  distance  soclo-cul- 
turella  entre  c«groupes  et  I'unlversite  est  si  grande  que  la  liaison  deman- 
de-ressource  s'effectue  peu  souvent  ou  de  fajon  accldentalle  et  anecdotlque. 

Alnsl  apparait  la  necesslte  d' elements  et  d'organlsmes  jouanj:  un 
role  speciflque  de  couplage  entre  I'unlversite  et  de  nouveaux  groupes  de 
demandeurs*    Le  role  de  ces  organlsmes  est  double  : 


Comme  def-'nitlon  de  professions  entlerement  constltueas,  la  presence  d'e- 
leraents   structuraux  est  g4neralement  reconnue  comme  necessalre  :  une  as- 
sociation profewi,  lone  lie,  un  corps  de  connalssance  speclfique,  une  orga- 
nisation de  forti^/iclon,  un  statut  legal.    Cf.  R.  H.  Hall,  Occupations  and 
the  social  structure.  Prentice-HalL,  Englewood  Cliffs,  N.J.,  1969,  p. 79. 
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d^une  part,  representer  les  nouveaux  groupt:5; 
Informer  I'unlverslte  sur  les  exigences  de  leur 
demande  et  contribuer  alnsl  a  la  definition  de 
la  reponsc^.  D' autre  part,  etabllr  avec  les  repre- 
nentants  de  Punlverslte  un  certain  nombre  de  re* 
gles  ayant  trait  a  1' application  de  la  reponse  et  en 
Imposer   le  respect  aupres  des  nouveaux  groupes 


En  fait,  un  systeme  perroar.ent  de  couplage  noue  deux  sortes  de  cou- 
plage,  I'un  avec  le  systeroe  ressource,  I'autre  avec  le  systeme  demandeur. 
Ce  double  couplage  s'effectue  avec  des  elements  permanents  :  directeur, 
Informateur,  consultant,  ou  comlt^s  conjoints,  consells  de  direction,  char- 
te  de  fondatlon, . . .  et  avec  des  elements  temporalres  :  comlte  de  travail, 
commission,  projet,  programme.      La  presence  de  ces  elements  temporalres 
est  absolument  necessalre  pour  conserver  au  systeme  perr^neat  souplesse  et 
ouverturc.         autre  part,  pour  que  ce  systeme  de  couplage  alt  Vautonoml;. 
et  l^homogenelte  necessalrcs  a  son  fonctlom  ement,  ces  elements  dolvent 
assurer  la  presence   de  trcla  sous^systentes  constltutlfs  d'une 
organisation  :  les  sous-systemes  de  decision,  J^operatlon  et  d' Infoi^ itlon  * 
(Cf.  Schema  4). 


Schema  4  :      SEPARATION  CT  LIAISON  DES  SYSTEMES  D£  OOUPLAGfi  (Tire  de  R. 
Havelock,  op.  cite,  p.  7-35). 
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//  System-*       ""^  f  ^ 


i 


-c.  demandeur 


o    ^*  *  .  c  \^  Systeme 

:         tomporalre  ^//'i-  a      permanent  d^^coupl^eH        \  Q  tj 

I       '     ft"    ^  ^^""^     »  *  *  Jj  Prcgramrncj 


Projet)    \\  / 
^  > 


I 


*    Cf.  G.  Metayer,  CybemetlQue  et  oruanlsatlons^  Paris,  Les  editions 
d* organisation,  1970,  p.  76-77. 
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APPLICATION  A  L> ANALYSE  DU  S,E,P. 


4.1  Le  S.E.P.  :  organlsme  de  couplage 

Le  processus  de  dlfferenclatton  du  S.E.P.  sera   vu  et  analyse 
comne  la  mlse  en  place  et  le  developpement  d* elements  devant  jouer  ce  nou- 
veau  role  de  couplage* 

La  raise  en  place  d'un  tel  systeme  suppose,  nous  I'avons  vu,  deux  sortes  de 
couplage,  I'un  avec  le  systeme  ressource  (i'Unlverslte),  1* autre  avec  le 
systeme  client;  dans  notre  cas  ce  systeme  client  est  represente  par  des 

g>-oup€s  soclaux    qui  ne  sont  nl  les  clients  habltuels  de  1*  unlverslte , 
nl  le  plus  souvent  assez  homogenes  et  autonomes  pour  constltuer  un  systeme. 
Ces  cicux  couplages  posent  done  des  probleroes  tres  dlfferents  :  dans  le  pre- 
mier cas,  le  couplage  est  a  operer  avec  une  organisation  tres  structuree, 
dans  le  second  cas  avec  un  public  indefini.      Ces  deux  couplages   ont  done  ete 
etudi^s  separement  suivant  leur  evolution  chronologique.    II  s'agissait 

ensuite      de  determiner  la  nature  d'un  33r8teme  jouant  de  fa§on  permanente 
ce  role  de  couplage  et  le  nouveau  modele  organisationnel  de  la  relation 
Universite-Environnement  qu'il  appelle. 

4.2  Choix  des  indicateurs  et  formation  des  indices 

Dans  1* ensemble  informationnel  const itue  par  les  sous-commissions 
d' etudes,  les  indicateurs  de  base  seront  les  propositions  soumises  et  accep- 
tees.      Ces  indicateurs  foumissent  les  indices  de  couplage  suivants  :  ele- 
ments rt  regies  officiels  de  fonctionneaient  du  systeme.      La  formation  de 
ces  indices  ne  pose  pas  de  probleroe    dans  la  mesure  ou  les  propositions  les 
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expllcitent.      L'etude  des  documents  offlclels  couvrant  le  travail  de  ces 
sou8**coinmlsslons    fut  suf*  sante  pour  les  ressortlr. 

L* information  fournie  par  ces  indices  n'est  pas  quantitative  et  con- 
cerns surtout  les  elements  et  les  regies  de  couplage  relativement  permanent 


La  mis    8ur  pied  de  programmes  pose  des  problemes  complexes  de  diag- 
nostic, de  pronostic,  de  conceptualisation,  de  decisions  collectives, 
et  constitue  un  champ  d'etudes  formelles  depuis  au  moins  1918  .  Nous 
n'etudierons  pas  cette  mise  sur  pied  dans  les  details*    Nous  par. irons  seu- 
lement  de  trois  indicateurs  -  personnes,  message,  temps  -  pour  caracteriser 
ces  differents  systemes  temporaires  de  couplage.       Dans  ces  systemes  tem- 
poralres  de  couplage,  quatre  grands  sous-ensembles  d« operations on t  ete  dis- 
tingue s  : 

-  la  gestation  qui  regroupe  les  operations  se  situant  entre  1' appari- 
tion de  I'idee  de  certlflcat  et  la  creation  d'un  comite  de  travail; 

•  la  conceptualisation,  qui  englobe  les  operations  se  situant  entre 
la  creation  du  comite  de  travail  et  1' approbation  du  certificat  par 
la  Commission  des  Etiudes; 

•  la  realisation  et  1' evaluation  qui  peuvent  amener  une  nouvelle  gesta- 
tion et  conceptualisation  du  certificat. 

C'est  k  partir  de  la  variation  des  trois  indicateurs  dans  ces  quatre 
ensembles  que  les  indices  vont  etre  construits  (Cf.  Tableau  1). 

* 

L'ouvrage  de  Franklin  BOBBITT,  The  Curriculum.  Boston,  Houghton  Mifflin 
Company,  1918,  est  cit^  gen^raleraent  conne  la  premiere  etude  systematique 
sur  le  problems* 
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TABLEAU  I 

CONSTRUCriON  DES  INDICES  DE  CAR.\CTaiISATION  DKS  CKRTIFICATS 


En&erobles 
d' operations 

Donnees  entree 

Personnes 

Message 

Temps 

Gestation 

Personnes  a  I'origlne 
du  projet,  selonqu'el- 
les  appartlennent  au 
S.E.P,  ou  non. 

Naluradu  mossa^^e  : 
idee,  cours,  pro- 
jet. 

Temps  approxi.T.atif 
de  gestation. 

ConcepLua  1  i    ll  o 

Composition  du  Comlle 
dc  Travail  so] on  I'ap- 
n      par uonanco  sysl<'nique 
das  inernbrer, . 

?roc;rarTU.ic 
Hlomont?  con»n:;i'.ns 
Kl.  de  Uof^*  Ti'G.ip.oi 
Elemonts  speclauK. 

[6j  Tet/ps  dc  ccncc  pi'.' ■.- 
lisat^on 

Tcrr.ps  d  '  approbr-.tl  c:v 

(j)  Nombre  d^  et  udiaiits 


Iccalif.ation 


Kva)  ual  i  0:1 


fy  Pourcontaf;^  do  person - 
n e s r  1< ( •  s s 0 V ' r c - s  no p a r - 
tenant      3  *l":ilv{;:*j.i  1 
et  n'y  app.ir tenant  pas 

(9)  Ratio  ?>ud./rcrs. -Kesr; 


Uorabrc  do  cours 
einpruntc's  aux 
cours  veji^ull  ers 
de  I'Univcrsi tc. 


(u\   Terps  dc  roali: 
(riepuis  dervr  v 
cours  juf  cu'  0:1 
tcr.bre  197:-.') . 


-ivali'-*.  lion  .-r/stc :  il  ([IT:  ou  non 
Q^^     Hetour  du  Vrc-rr..-Mr  A  la  CI.. 
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RESULTATS 

5.1      COUPLAGE  S,E.P.-UNIVERSITE 

En  resume  et  conclusion  de  1' analyse  de  ce  couplage,  les  donnees 
sulvantes  ressortent.      Des  elements  de  couplage  ont  ete  mis  sur  pled 
offlciellement  au  Service  d' Education  Permanente  et  k  1' University .  Ce 
sont  : 

-    solt  des  Indlvldus  :  k  1' unlverslte ,  un  vlce-recteur  responsable, 
entre  autres  choses,de  I'Educatlon  Permanente  et  un  adjoint 
au  doyen  pour  I'Educatlon  Permanente  dans  chaque  departement 
ou  faculte;  au  S.E.P.,  un  dlrecteur; 

•  solt  des  comltes,  composes  de  representants  du  S.E.P. ,  de  I'unlver- 
site  et  du  public  adulte  :  le  Consell  du  S.E.P.  (CX)NSEP)  com- 
prend  9  personnes  de  I'unlverslte,  1  du  S.E.P.,  5  du  public. 
Pour  chaque  programme  de  formation  credlte,  un  comlte  de  tra- 
vail et  un  comlte  pedagoglque  existent  avec  une  representation 
trlpartle  (Cf.  Tableau  2). 

Les  demleres  decisions  offlclelles  d'ensemble  qui  determlnent  le 
role  de  ces  elements  et  leur  articulation  datent  de  1968  et  1970.  Cepen- 
dant  le  systeme  de  couplage  qui  en  resulte  ne  repond  que  partlellement  a 
la  question  fondamentale  posee  des  1957  :  "A  qui  1' Initiative  des  opera- 
tions revlent-elle  quand  11  s'aglt  d'etendre  les  fonctlons  educatlves  de 
1* unlverslte  au-dela  des  cadres  habltuels  En  effet  cette  question 

souleve  prlorltalreraent  des  probl^mes  d'ordre  declslonnel  et  operatlonne  1 , 
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SCHEMA  5 


COUPLAGE  S.E.P.-UNIVERSITE 


S.B.P. 


Unlverslte      ^ , 

© 


©  \ 

©  \ 
© 

m 

©  / 

LiJ 

©  / 

Vlce-recteur  responsable  entre  autres  choses  de  1' Education  Permanente, 

Adjoint  au  doyen  pour  1' Education  Permanente  dans  chaque  departeraent  ou 
faculty « 


© 


Dlrecteur  du  Service  d' Education  Permanente. 


(3 


Consell  du  S.E.P.  trlpartl 
Comltesde  travail  trlpartls 
Coml tes  p^dagogl que  s    tr 1 par 1 1 s 
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et  la  plupart  des  elements  offlclels  coraposant  le  systeme  sont  d'ordre  In- 
forroatlonnel  : 

•  C'est  evident  pour  leeComltesde  travail  et  lesCoraltesp^dagoglques 
qui  cuelllent  et  traltent  de  1* Information  a  souroettre  au  Consell 
du  S.E.P..      Mais  ce  Consell  du  S.E.P.  dont  la  representatlvlte  de- 
vralt  assurer  un  large  champ  de  decision  dolt  s'en  reraettre  au  ver- 
dict des  consells  de  faculte  :  alnsl  un  representant  de  faculte  sl^- 
geant  au  CONSEP  peut  approuver  un  pro jet  qui  est  ensulte  refuse  par 
sa  faculte.      Le  caractere  repr^sentatlf  de  ces  coroltes  ou  consells 
de  couplage  est  vu  comme  devant  assurer  davantage  une  distribution 
de  1' Information  qu'une  delegation  de  pouvolr. 

•  Le  role  du  vlce-recteur ,  fesponsable  entre  autres  choses  de  1' Educa- 
tion Permanente,  et  celul  de  I'adjolnt  au  doyen  pour  I'educatlon  per- 
manente  au  niveau  des  facultes  n' ont  jamais  efce  clalrement  deflnls  et 
peu  de  traces  de  I'exerclce  de  leur  pouvolr  sont  trouvees.      L^i  aussl 
la  perspective  de  falre  clrculer  1' Information,  cette  fols  au  niveau 
de  la  haute  direction,  semble  avoir  prime  celle  de  deleguer  le  pouvolr 
Quant  a  la  trolslerae  personne  prevue  of f Iclellement ,  le  dlrecteur  du 
S*E.P.,  ce  n'est  que  receraraent  qu'elle  a  ete  noramee  membre  reguller 
de  la  Commission  des  Etudes,  et  encore  est-ce  k  tltre  personnel. 

N'ayant  done  pas  d' elements  decislonnels  pour  tralter  d'egal  a  egal 
avec  les  facultes,  le  S.E.P.  en  a  encore  molns  pour  prendre  1' Initiative  d'u 
tlllser  de  fagon  conjolnte  leurs  ressources  au-dela  de  leur  cadre  habltuel. 
Si  cette  utilisation  a  pu  cependant  s'effectuer,  c'est  grace  a  I'actlon  d'e- 
lements  operati onnels  curleusement  absents  de  tout  texte  offlclel  et  dont 
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I'appellatlon  a  change  :  coordonnateurs ,  conselUers  pedagoglques  et  ac- 
tuellement  responsables,      Profltant  des.larges  zones  d' Incertitude  lals- 
8^68  par  les  problemes  de  jurldlctlon  non  tranches  ou  tranches  de  fagon 
non  fonctlonnelle,  ce  sont  ces  elements  operatlonnels  qui  ont  developpe 
le«  certlflcats  par  des  alliances  offlcleuses  avec  ou  sans  les  facultes. 
Ces  ^Uments  operatlonnels,  pour  pouvolr  d^velopper  leurs  actions,  aapl- 
rent  A  une  reconnaissance  offlclelle.      Le  systeme  offlclel  de  couplage 
de  1970  les  Ignore. 

Le  sentiment  d' Insatisfactlon  des  responsables  de 
programmes      vls-a-vls  du  systeme  de  couplage  S.E.P. -Unlverslte  ne  tlent 
done  pas  sculement  k  I'assemblage  plus  ou  molns  facllltateur  des  elements 
de  ce  gystime,  11  tlent  surtout  h  l*absence  offlclelle  d'elements  decision 
nels  et  operatlonnels  dans  ce  systeme,  absence  qui  n'en  fait  qu'un  embryon 
de  systeme. 
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5.2        COUPLAGE  S.E.P. -PUBLIC 

De  1' analyse  des  destlnatalret  vls^s  par  les  23  certlflcats,  11 
ressort  que  (cf.  schema  6)  : 

1-  15  certlflcats  vlsent  des  destlnatalres  qui  s'lns&rent  a  la  fols 
dans  une  profession  et  un  service  precis  :  Education  (11),  sante 
(3),  administration  raunlclpale  (1).      Ces  certlflcats  r^pondent 

A    dts  besolnsd' alustement  professlonnel  d' enselgnants  ou  de  para* 
enselgnants  (orlenteurs,      blbllothecalres ,  responsables  des  ser- 
vices aux  etudlants),  d' Inf Irmieres  ou  d' admlnlstrateurs,  besolns 
provoques  souvent        par  une  Intervention  gouvemementale  dans 
la  structuratlon  de  ces  services. 

2-  7  certlflcats  vlsent  des  personnes  engagees  dans  un  processus  de 
professlonnallsatlon  relatlveraent  autonome,  dans  le  sens  oix  ce 
processus  n'est  pas  relle  specif Iquement  k  des  organlsmes  de  ser- 
vlcesou  de  production.      Ce  processus  de  professlonnallsatlon  peut 
etre  plus  ou  molns  avance  :  presence  ou  non  des  dlfferents  ^l^raents 
structuraux  constltuant  une  profession.      En  prenant  1' existence 
d'une  association  prof esslonnelle  comme  crltere  de  partage,  5  cer- 
tlflcats 8e  detachent,  concernant  des  fonctlons  llees  surtout  au  tral- 
tement  de  1' Information  :  traduction,  publlcite,  relations  publlques, 
relations  Industrlelles,  recherches  op^ratlonnelles.    Les  deux  autres, 
animation  et  animation  de  d^velopperoent ,  concement  des  personnes 
qu'aucune  association  prof esslonnelle  ne  regroupe  et  dont  le  proces- 
sus de  professlonnallsatlon  est  molns  avance. 
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SCHaiA  6 
COUPLAGE    S.E.  P. -PUBLIC 
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Ces  deux  groupes  de  CM^f Icats  ^se-<ilfferenclent  slgnif Icatlveraent 
en  ce  qui  conceme  les  operations  de  gestation  : 


DESTINATiIRE 

INITIATIVE 

FORME  INITIALE 
DE  MESSAGE 

TOIRS 

Professloi^^ 

Non-SEP 

Programme 

variable 

Service 

Profession 

SEP 

Idee-cours 

long 

II  en  ejt  de  meroe  pour  le  temps  de  conceptualisation  et  le  nombre 
d^^tudlants  et  de  personnes  ressources* 

L* Interpretation  que  nous  donnons  de  ces  differences  ne  sera  pas 
presentee  icl»    Nous  preferons  faire  ressortlr  le  fait  sulvant  :  un  seul  cer*- 
tificat  (Etudes  Quebecolse  )  n*est  pas  dans  une  perspective  professionnel*- 
le  et  re  Joint  des  personnes  situ^es  dans  I*  ensemble  des  utllisateurs  de  la 
connaissance. 
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Ce  fait  revele  que  le  couplage  avec  le  public  s'est  opere    par  le 
blals  des  professions,  selon  la  merae  structure  llnealre  des  roles  qui  sous- 
tend  le  circuit  macro-social  de  connalssance  (Cf.  Schema  2). 

Le  changement  apporte  par  ce  couplage  dans  le  circuit  de  connalssance 
est  un  changement  d'equlUbre  dans  le«  llmltes  du  sous-systeroe  professlonnel , 
mala  pas  un  changement  de  structure*     Un  changement  structure 1  de  ce  cir- 
cuit    Impllqueralt  des  couplages  avec  d'autres  sous-systemes  : 

•»  solt  qu'lls  appartlennent  encore  au  monde  de  la  pratique  :  sous-sys- 
temes des  organlsmes  de  service  ou  de  production;  les  ressources 
unlversltalres  seralent  couplees  avec  les  besolns  de  formation 
d'une  ecole  en  tant  qu'^cole  ou  avec  une  entreprlse  en  tant  qu'en- 
t reprise ; 

•  solt  surtout  qu'lls  appartlennent  au  raonde  de  1' utilisation  : 

vie! 1 lards,  regrouperoent  des  locatalres,  des  consommateurs ,  des 
malades,  ... 

D'une  structure  llnealre,  on  passeralt  alors  a  la  structure 
Id^ale    ou  tous  les  couplages  sont  possibles  (Cf.  Schema  1). 

Une  unlverslte  d» Education  Permanente,  deflnle  roeme  soraraalreraent  com- 
me  capable  de  rejolndre  toutes  les  classes  d'age,  ne  pourra  se  reallser  qu'en 
operant  un  changement  structurel  du  circuit  de  connalssance;  slnon  elle  ne 
reallsera  que  P Information  continue  de  ses  clients  les  plus  proches  (les  pro- 
fesslonnels  et  semi -prof esslonnels). 

Les  nouveaux  couplages  non  seulement  repondralent  a  de  nouvelles 
demandes  et  mettralent  les  ressources  unlversltalres  a  la  disposition  de 
1' ensemble  des  groupes  de  la  soclete,  mals  aussl  pourralent  orlenter 
les  groupes  sociaux  de  recherche  selon  d'autres  poles  que  le  leur  ou 
celi'l  de  1* application  des  connalsssances  • 
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5.3     UN  SYSTEMS  SOCIAL  PERMANENT  DE  CPUPLAGS 

Let  limites  du  couplage  avec  le  public  s'expllquent  en  partle  par 
celles  du  couplf  3  avec  I'universlte.  Nous  avons  vu  que  1' absence  d'e- 
l^ments  d^clslonnels  et  opiratlonnels  offlciels  propres  au  S.E.P.  k  cet 
endroit  n'en  falsalt  qu'un  erabryon  de  systirae.  Cet  ^tat  le  rend  Inca- 
pable d' avoir  I'autonorale  et  1 'horaoginelt^  necessaires  pour  reropllr  son 
role  de  fason  speclflque;  11  le  rempUt  mals  dans  le  prolongewent  de  la 
dynanlque  tracfltlonnelle  qui  unit  I'unlverslte  k  son  envlronnement . 

SI  une  university  veut  rompre  cette  dynaralque,  condltlonn^e  par 
une  certalne  articulation  des  roles  de  production,  diffusion  et  utilisa- 
tion des  connalssances,  les  elements  qui  se  trouvent  dans  cette  zone  In- 
tens^dlalre,  prenent  uno  forte  valeur  strateglque  et  dolvent  etre  renfor- 
cis.      Nous  voyons  ce  renforcement  dans  le  sens  de  la  constitution  d'un 
systAme  social  complet  de  couplage,  c'est-A-dlre  comportant  off IcleT -ment 
des  eUraents  specif Iques  de  decision,  d' Information,  d'op^ratlon. 

5*3.1      Elements  speclflques  de  decision 

L'etat  systemlque  embryonnaire  du  S.E.P.  est  fruit,  en  partle,  d'un 
pole  d^clslonnel  qui  deroeare  presque  excluslveroent  1' apanage  des  corps  d'ad- 
mlnlstratlon  generale  de  I'unlverslte.  Le  processus  de  dlff^renclatlon  du 
S.E.P.  est  constamment  soumls  k  ce  pole  qui  est  exterleur  k  lul-meme  et  ou 
le  S.E.P.  est  peu  repr^sent^.  Une  representation  plus  grande  du  S.E.P.  k 
ce  pole  et  une  delegation  accrue  du  pouvolr  declslonnel  a  I'organlsme  trl- 
partl  qui  est  cens^  d^jA  dlrlge  le  S.E.P.  (CONSEP)  specif leralent  des  eU- 
roents  de  decision  d^jA  exlstants. 
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5*3.2    Elements  speclflaueg  d' information 

Ces  elements  ne  peuvent  etre  reduitt  aux  sous-connlsslons  d' etu- 
des qui  periodlquement  recueillent  et  traltent  I ' information  necesaaire 
pour  redefinir  le  systAme.    La  mise  en  place  d'elements  permeinenta  d'in- 
formation  s'i.-npose  k  I'entree  et  k  la  sortie  du  syst^me  ainsi  qu'A  I'in- 
terieur  : 

-  a  I'entree  :  un  Element  ''tete_chercheu8e''  et  un  autre  "analygeur". 
Le  premier  scrute  I'environnement  tel  un  radar  pour  identifier  1,»8 
changements.  Le  second  trie  les  informations  fournies  par  la  tete 
chercheuse  et  les  transraet  aux  autret  ^Uments  du  syst4me; 

-  a  la  sortie  :  un  eUment  ^valuateur  apprecie  les  r^sultats  du  sys- 
t^me  et  fournit  aux  autres  ^Uments  un  4tat  des  ressources,  des  la- 
cunes  et  des  performances  du  syst^rae; 

-  a  I'interieur  :  un  eUment  "designer"  est  constamment  ^veilU  aux 
conditions  de  f onctionnement  du  systime  total  pour  identifier  si 
un  meilleur  ^rofil  ne  serait  pas  plus  efficace. 

5«3«3      EUments  specif iques  d' operation 

Les  op^rationnels  du  S.E.P.,  -'est-A-dire  ceuK  qui  r^alisent  la 
jonction  entre  des  demandes  et  des  ressources  sociales  de  formation,  ne 
8ont  pas,  nous  I'avons  vu,  des  enseignants.    lis  sont  appel^s  responsa- 
ble.  de  programme  et  en  fait  sont  responsables  de  multiples  operations 
allant  de  la  gestation  du  programme  jusqu'A  .on  Evaluation  en  passant  par 
la  conceptualisation  et  l-i  realisation.      Us  ne  sont  done  pas  plus 
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adadnlstr^teurs  ou  technicians.      lU  assuBMnt  et  cumulent  un  certain  no 
bre  de  fonctlons  qui  devront  sans  doute  se  specifier  pour  qu'un  systioe 
de  couplage  se  developpe  :  analyseur  de  denande,  anlmateur,  sp^clallstes 
de  structuration  de  contenu,  Integrateur  de  connalssance,  orlenteur,  ... 
Encore  que  la  nicesalte  d'une  fonctlon  synthase  dciseure. 


^•3*^     Articulation  de  ces  trola  ensembles  d' elements 

Pour  synthetlser,  nous  vlsuallsons     une  articulation  possible  de 
ces  ^l^ments    selon  un  modele  de  syateme  social  coraplet  auto-regle  et 
auto-orlente*  (cf.  schema  7). 


SCHEMA  7* 


Kval  nation 


*    K.  Feyereisen,  A.  Florlno,  A.  Novak »  Supervtston  and  Curriculum 

Renewal  :  a  Systems  Approacha  New  York,  Appleton  Century  Crofts. 
1970,  p.  51. 
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OONaUSION 


1.  Quelles  que  solent  les  dlfflcultes  et  1* approximation  d'une  ana- 
lyse comblnant  une  approche  macro  et  ralcro-soclale,  c'est  la  seule  qui 
nous  a  semble  repondre  a  notre  objet  et  projet  de  recherche  :  degager 
I'apport  en  tant  qu* organisation ,d'un  service  d'educatlon  permanente,  a 
la  construction  d'une  unlverslte, capable  de  repondre  aux  demandes  educa- 
tlves  de  groupes  soclaux,  dl-f ferencles  par  leur  appartenance  tant  a  des 
classes  soclales  qu*a  des  clas;;es  d*age. 

Cette  approche  a  perinis  de  roodellser  le  fait  que  1' unlverslte 
n'est  pas  ouverte  de  fa^on  uniforme    a  tous  Ics  secteurs  de  son  environ - 
neraent  socio-culturel,      Get  envlronnement  n*est  nl  un  vide  social,  nl 
une  Sonne  d'lndlvldus  isoles  mais  en  ensemble  de  groupes  qui  s'artlculent 
selon  un  macro-systeme  de  flux  de  connalssance.      Ce  macro-systerae  orlente 
la  relation  de  1' unlverslte  avec  certains  groupes  appartenant  presque 
excluslvement  au  sous-syst^me  des  professions  entierement  constltuees. 
Cette  orientation  condltlonne  la  formation  des  "jeunes"^vue  conme  pr^pa^ 
ratolre  a  1' entree  dans  la  vie  prof esslonne lie;  elle  risque  aussl  de  con- 
dltlonner  la  formation  des  adultes  et  1' education  permanente,  si  llbre 
cours  est  lalsse  a  sa  d3nia]ai^que* 

2.  La  creation, a  l^Unlverslte  de  Montreal  en  1952,  d'un  Service  d' Ex- 
tension de  I'enselgnenent  et  dans  son  prolongement ,  en  1968,  d'un  Service 
d' Education  Fermanente,  marque  une  volont^,  de  la  part  des  corps  universl- 
taires  d' administration  g^n^rale,  do  nouer  et  de  syst^matiser  des  relations 
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avec  de  nouveaux  groupes  sociaux.      Nous  avons  vu  qu'en  ce  qui  concerne 
les  relations  aboutiMant  k  une  formation  creditee,  c'est-A-dire  les  re- 
lations impliquant  de  fagon  acaderaique  I'universite,  les  groupes  rejoints 
appartiennent  encore  niajoritairement  aux  sbus-systemes  professionnels". 
Cette  appartenance  est  de  deux  types  : 

-  le  premier  la  conjugue  avec  une  appartenance  etroite  a  des  organis- 
mes  de  services  :  education,  sante.    C'est  le  cas  des  ense^^^ants 
et  des  para-enseignants  dans  le  systene  scolaire ,  celui  des  infir- 
mieres,  des  techniciens  et  des  admlnistrateurs  dans  le  systems  hos- 
pitalier.    Cette  double  appartenance  a  des  avantages  et  des  incon- 
venlents.    Nous  soulignons  1 ' inconvenient  bureaucratique  qui  pro- 
vient  de  1 • appartenance  a  des  organismes  precis  et  qui  peut  limiter 
la  definition  ou  redefinition  professionnelle  auxqnelles  correspond 
la  formation  qui  s'adresse  a  ces  groupes.      Un  exemple  de  cet  incon- 
venient est  la  formation  d* agents  de  loisir, destinee  initialeroent  a 
des  directeurs  municipaux  de  la  recreation  ou  des  centres  culturels. 
Le  developpement  de  cette  formatior  est  limlte,  entre  autres,  par  un 
profil  professlonnel  etroit  trop  conditlonne  par  1' ap- 
partenance iminicipale  des  interesses; 

-  le  second  consiste  en  une  semi -appartenance  au  sous-systeme  profes- 
.sionnel  et  concerne  des  groupes  engages       dans  un  processus  de  pro- 

fessionnalisation.     Ce  processus  est  assez  avance  pour  les  traducteurs, 
les  chercheurs  opera tionnels,  les  agents  de  relations  industrielles, 
de  relations  publlques  et  de  publxcit^;  moins  avanc^  pour  les  agents 
d' animation  et  d' animation  du  developpement.      Globalement,  on  peut 
caract^riser  les  difficultes  pour  etablir  et  developper 

* 

Le  seul  groupe  qui  fasse  exception  est  celui  re joint  pat  le  certificat  d* Etu- 
des Queb^coises  qui  s'adresse  h  '"toute  personne  desireuse  d'acquerir  une  con- 
nalssance  plus  approfondie  du  milieu  quebecols". 
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des  relations  de  formation  avec  lea  groupes  de  ce  second  type  com- 
rae  Inversement  proportlonnelles  au  degre  de  professlonnallsatlon 
de  ces  groupes.      En  effet  I'exlstence  d' associations  profession- 
nelles,  d'un  corpus  de  connaissance  sp^cifique  et  d' organisraea 
de  formation  concemant  ces  groupes  sont  des  elements  essentiels 
k  la  construction  et  au  developpement  d'une  relation  collective  de 
formation.      Leur  absence  cree  des  lenteurs,  des  plafonnenents  et 
des  efforts  pour  les  creer. 

L'analyse  du  travail  et  les  difficultes  qu'a   rencontres  le  S.E.P. 
pour  etablir  la  liaison  de  I'unlversite  avec  ces  groupes  ne  doit  pas  faire 
oublier  le  denominateur  comnun  de  ces  groupes  :  leur  appartenance  au  sous- 
systeme  professionnel.      Cette  appartenance  est  fin  indicateur    brut  reve- 
lant  que  la  dynamique  du  S.E.P. ,  en  ce  qui  concerne  les  relationSi."credit4rf» 
avec  I'environnement.est  la  meme  que  celle  de  1' universite.merae  si  les  grou- 
pes d'age    varient.    Le  changement  apport^  dans  ie  macro-syst^me  du  flux  da 
connaissance  est  un  changement  d'equilibre  dans  les  limites  du  sousrsystftme 
professionnel.    Ce  changement  favorise  I'ajustement  de  certaines  professions 
et  I'emergence  de  nouvelles  mais  n'affecte  pas  la  structure  de  ce  macro-sys- 
teme  de  connaissance  :  les  fessources  universitaires  de  formation  sont  utili- 
sees  presque  exclusivement  par  les  groupes  economiques  de  production  les 
plus  scolaris^s  et  pratiquement  pas  par  d'autres  groupes  se  situant  par  exem- 
ple  dans  I'autre  ensemble  social  qui  est  constitue  par  les  utilisateurs  ul- 
times  de  la  connaissance  et  -li  peut  etre  appele  I'univers  des  consommateurs. 


3.  Nous  avons  vu  que  cette  similitude  des  groupes  sociaux  rejoints  par  le 

S.E.P.  et  I'Universite  au-dela  des  differences  d'age      est  due  en  partie  k  un 
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etat  erabryonnalre  du  S.E.P.  cornme  systeme  social  :  ses  Elements  declAn- 
neU  et  op^ratlonneU  ne  sont  pas  reconnus  of f Iclellement  de  fa$on  spe- 
clfique  par  les  corps  unlversltalres  d'admlnlstxatlon  generale.  Get 
etat  embryonnalre  ne  lul  donne  pas  I'autonorale  et  I'homogen^lte  n^ces- 
salres  pour  lompre  I'orlentatlon  qui  relle  I'unlverslt^  a  cortalns  grou- 
pes  prlvllegles  de  I'envlronnement, 


y.  Una  Unlverslte  d' Education  Permanente  peut  tres  blen  se  concevolr 

Conine  rendant  permanente,  par  un  certain  norabre  d' amenagements  au  niveau 
des  departeraents  deja  exlstants,  la  formation  deja  donnee  aux  groupes  en 
relation  avec  elle.      Dans  cette  perspective  un  organisms  conme  le  S.E.P. 
n'a  joue  qu'un  role  de  suppleance.      II  peut  dlsparaftre  quand  les  depar- 
teraents sont  prets  et  capables  de  jouer  ce  role. 


Mais  dans  la  mesure  ou  1' education  permanente  ImpUque  plus  que  la 
continuation  de  la  formation  deja  donnee  et  appelle  une  restructuratlon 
du  macro-syst^roe  social  du  circuit  des  connalssances,  alors  le  role  qu'a 
joue  le  S.E.P.  n'est  pas  seulement  un  role  de  suppleance  mals  aussl  et 
surtout  un  nouveau  role  qui  peut  etre  appeU  de  couplage  entre  de  nouvel/ 
les  deraandes  et  d'anclennes  ressources  de  formation.      Les  Umltes  analyst 
dans  I'exerclce  de  ce  role  provlennent  de  son  4tat  embryonnalre  du  a  un 
processus  encore  li\achev4  de  dif ferenclatlon  de  1' organisation  unlversl- 
talre  classlque.      Mals  le  lieu  ou  11  se  trouve  -  a  la  p6rlph4rle  de  I'unl 
verslt6  -  est  le  lieu  strat^glque  ideal  pour  exercer  ce  role  et  orlenter 
la  relation  universlt^-envlronnement  selon  une  dynamlque  volontarlste . 
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Parachever  ce  processus  de  dlf f ^renclatlon  en  constltuant  cet  erabryon 
de  «ysterae  en  systerae  coraplet  consacreralt  I'apport  que  le  S.E.P.  peut 
apporter  h  une  unlverslte  s'lnsplrant  de  cette  seconds  dimension  de 
!• education  perraanente  :  une  organisation  exlsteralt  dont  le  role  prin- 
cipal seralt  de  nouer  des  relations  avec  de  nouveaux  groupes  soclaux, 
pour  que  demandes  et  ressources  unlversltalres  de  formation  se  deflnls- 
sent  et  se  redef Inlssent  par  confrontation  p^rlodlque  et  renouvelee. 

5.  Le  role  de  cet  organisme  de  couplage  est  double  :  d'une  part,  as- 
surer la  representation  de  nouveaux  groupes,  Informer  I 'unlverslte  sur 
les  exigences  de  ceux-cl  et  par  la,  Contribuer  a  la  nature  et  au  mode 
d'utlllsatlon  des  ressources;  d'autre  part,  etabllr  avec  les  represen- 
tants  de  1' unlverslte  un  certain  norabre  de  rigles  quant  h  la  diffusion 
des  ressources  et  en  Imposer  le  respect  aupres  des  nouveaux  groupes. 

Ce  double  role  met  1' organisme  de  couplage  dans  une  situation  perraanente 
de  tension  et  peut  I'amener  k  s' identifier  de  fa?on  exclusive  soit  k  Vuni 
verslt^  (tendance  a  1' Integration),  soit  aux  groupes  soclaux  (tendance  au 
parall^llsrae).      Epouser  une  de  ces  tendances  ne  favoriserait  a  notre  avis 
nl  I'unlverslte,  ni  les  groupes  soclaux,  car  ce  seralt  reproduire  un  model 
de  cloisonnement  et  non  instaurer  un  organisme  de  confrontation.    Vivre  et 
tralter  cette  tension  au  lieu  meme  ou  elle  se  noue  -  c«est-a-dire  dans  les 
interrelations  -  nous  mmble  etre  un  moyen  privilegie  de  changer  la  struct u 
re  du  circuit  de  connalssance  et  d' engager  unlverslte  et  groupes  soclaux 
dans  un  processus  de  formation  perraanente. 

6.  Le  S*E.P.  est  ne  dans  1' interstice  social  pro^que  par  I'eclatement 
de  I'ajusteraent  force  de  la  ''demande"  a  1' off  re  educative  qu'entrafnait 
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un  quasi -non opole  unlversltalre  francophone  dans  la  region  metropolltalne . 
Get  Injterstlce,  de  plus,  s'allraente  du  phenomene  plus  general  de  la  crise 
des  organisations  educatlves  dont  1' off re  est  loin  de  rencontrer  les  deman- 
des,  meroe  celles  qui  lul  sent  encore  canails^es.      Get  Interstice  a  done 
tendance  plus  a  s'agrandlr  qu'a  se  redulre,  et  certains  parlent  de  fosse 
ou  d'abrrae  qu'll  est  preferable  de  supprlmer  en  supprlraant  I'un  des  bords  : 
les  organisations  educatlves.      Quol  qu'lls  en  solent  a  long  terme,  11  est 
Ind^nlable  que  ces  organisations  poss^dent  encore  des  ressources;  ell^peu*- 
vent  encore  etre  utiles  a  condition  que  leur  offre  solt  redeflnle  et  reca- 
nallsee  par  une  confrontation  dlrecte  avec  des  groupes  sociaux^reconnus 
conroe  poss^dant  eux-aussl  du  savolr.      Or  les  organisations  educatlves, 
model^es  par  leur  anclen  role  de    transmission, re  possedent  pas  d' organi smes 
de  confrontation  de  ce  genre.       La  creation  et/ou  le  developperoent  de  tels 
organismes      semble  un  element  essential  de  reponse  k  la  crlse  de  la 

production,  de  la  diffusion,  de  1' utilisation  et  de  1' appropriation  du  savol 


ROLE  THEORY,   FUSION  PROCESS  THEORY  AND  A   RATING  SCALE  AS 


USED  IN  AN  EXTENSIOIn   RESEARCH  STUDY   IN  WEST  PAKISTAN^ 


Muhaiumad  Kallm  Qamar 

General  Background  of   the  Study; 

The  general  purpose  of  the  study  was  to  determine  the 
working  relationship  between  research  and  agricultural  extension 
with  emphasis  on  the  role  of  the  subject-matter  specialists  in 
West  Pakistan.     A  stratified  random  sample  of  respondents  re- 
presenting Extension,  West  Pakistan  Agricultural  University, 
Lyallpur,  and  Research  Departments  was  drawn  from  the  three  Pro- 
vinces of  West  Pakistan*     The  author,   then  a  Graduate  Assistant 
at  the  American  University  of  Beirut,  Lebanon,  went  to  West  Pakis- 
tan and  collected  necessary  data  through  a  field  survey,  using  a 
special  interview  schedule,   and  interviewed  the  respondents  during 
the  summer  months  of  1971,     The  data  obtained  were  coded  and 
punched   into  IBM  cards  at   the  Computer  Center  of  the  American 
University  of  Beirut  and  necessary  calculations  made  for  inter- 
pretation of  the  results.    (Qamar,  1972) 

Theoretical  Background ; 

Theory  is  a  set  of  assumptions  from  which  can  be  derived  by 
logico-mathemat ical  procedures  a  larger  set  of  empirical  laws • 


*Presented  in  the  Adult  Education  Research  Conference,  - 
Montreal,  Canada;  April  4-6,  1973. 

**Research  Assistant,   Department  of  Education,  Cornell 
University,   Ithaca,  New  York. 
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Theory  Is  a  guide  to  action,  a  guide  to  the  collection  of  facts, 
a  guide  to  new  knowledge.     One  of   the  most  valuable  uses  of  theory 
is  to  explain  the  phenomenon  under  examination   (Griffiths,  1960, 
pp.   35-37).     There  is  an  increasing  trend  to  study  the  structure 
and  functioning  of  organizations  through  the  application  of  various 
administrative  theories.     In  the  study  in  focus,  "role  theory"  and 
"fusion  process  theory"  were  used. 

Role  Theory; 

Role  theory  has  been  applied  in  a  number  of  studies  concerning 
analysis  of  administrative  structures  of  varfous  organizations  and 
especially  concerning  analysis  of  roles  played  by  the  persons 
holding  different  positions  in  different  kinds  of  organizations. 

Parsons   (1956)  has  suggested  that  the  structure  of  an  organiza- 
tion may  be  analyzed  either  from  the  point  of  view  of  the  organiza- 
tional culture  and  its  institutionalized  manifestations  or  from  the 
point  of  view  of  the  suborganizat ions  or  roles  which  participate 
in  the  functioning  of   the  total  organization.     According  to 
Getzels   (1958),  a  role  has  certain  normative  obligations  and  res- 
ponsibilities, which  may  be  termed  as  "role  expectations";  and  when 
the  role  incumbent  puts  these  obligations  and  responsibilities  into 
effect,  he  is  said  to  be  performing  his  role.     This  study  was  con- 
cerned with  the  latter  point  of  view  of  Parsons   (1956)   and  role 
definition  by  Getzels   (1958).     Extension  Organizations,  Agricul- 
tural Research  Institutes,  and  the  University  are  the  organizations 


having,   individually,  various  heirarchical  levels  signifying 
horizontal  and  vertical  relationships  among  various  positional 
groups.     These  positional  groups  are  suborganizat ions  or  roles 
which  participate  in  the  functioning  of   the  total  individual  or- 
ganizations.    The  subject-matter  specialists  attached  with  these 
organizations  are  the  focal  suborganizat ional  group  which  has 
certain  normative  obligations  and  responsibilities  regarding  re- 
search and  extension  indicated  as  dependent  variables.     The  study 
dealt  with  two  aspects;   that  is,  to  what  extent  this  particular 
suborganiza tional  group  is  putting   these  obligations  and  responsi- 
bilities into  effect  at  present  and   to  what  extent  various  obli- 
gations and  responsibilities  should  be  performed  by  them  in  the 
future. 

Fus  ion  Pro  cess  Theory 

The  "fusion  process"  with  which  the  Yale  group  has  become 
identified  has  been  developed  over  a  period  of  more  than  20  years 
of  study  in  many  types  of  organizations,   such  as  a  department  of  a 
hardware  factory,   a  business  machines  factory,   a  telephone  company, 
a  steel  mill,   two  local  unions,   a  commercial  bank,   an  educational 
institution,  a  research  organization,  a  bank,  and  a  hospital 
(Pfiffner  and  Sherwood,   1960,   pp.   373).     The  primary  goal  has 
been  the  creation  of   an  integrated   theory  of  human  behavior  that 
would  cut  widely  across  all  forms  of  social  organization  and  would 


provide  a  framework  for  ''interpreting,  understanding,  predicting, 
and  regulating  behavior"   (Bakke  and  Argyris,   1954,   pp,  1). 

The  first  problem  in  all  organizational  life  is  how  to  take 
an  aggregate  of  varied  individuals,  with  varied  capacities  and 
predispositions  and  get  them  involved  in  cooperative  activity 
which  adds  up  to  success  for  the  organization  and  satisfaction 
for  the  individuals  concerned.     In  short,   the  problem  is  to  inte- 
grate the  individual  participants  with  the  organization  (Bakke 
and  Argyris,   1954,   pp.   4).     The  fusion  process  is  said  to  occur 
when  the  "individual  obtains  the  maximal  expression  of  his  per- 
sonality that  is  possible,  and   . . .   simultaneously,   the  organization 
has  its  demands  fulfilled  at  the  highest  possible  level"  (Argyris, 
1953,  pp.  130).     One  of  the  principal  features  of  the  social 
organization  is  "associating  and  solving  problems  together  over 
time  in  a  state  of  interdependency"   (Pfiffner  and  Sherwood,  1960, 
pp.   374).     The  fusion  process  is  composed  of   individuals,  formal 
organizations,  and  informal  groups  engaged  in  their  customary  and 
characteristic  activities  interacting  to  achieve  a  balance  or 
equilibrium,  which  Bakke  and  Argyris   (195A)  have  chosen  to  call 
"fusion'' .     This  simul taneous  operation  develops  for   the  individual 
a  "role"  which  constitutes  a  fusion  of  his  formal  and  informal 
functions  and  conduct.     A  role  in  turn  can  be  broken  down  into 
units  of  behavior  called  "activities",  which  make  up  fusions  of 
formal  and  informal  tasks  or  acts.     The  positional  term  applied 


to  these  formal  and  informal  fusions  and  the  standing  is  "status" 
(Pfiffner  and  Sherwood,   1960,   pp.   376).     In  order  for  both  the 
individual  and  the  organization  to  exist  they  must  maintain  their 
internal  organization  and  they  must  adapt  to  their  external  en- 
vironment  (Argyris,   1953,  pp.   128).     The  organizations  are  inter- 
dependent "processes"  that  go  on  simultaneously  and  are  engaged  in 
by  individuals.     A  process  is  a  course  or  sequence  of  behavior 
accomplishing  a  necessary  purpose  while  a  purpose  is  an  intended 
sequence  (Argyris,   1953,   pp.  131). 

The  present  study  was  partly  based  on  the  above  mentioned 
fusion  process  concepts.     Some  independent  variables  liV;e  age, 
education,   salary,   satisfaction  with  salary,  number  of  supervisors, 
length  of  service  of   the  respondents  had  been  included   in  the 
questionnaire  to  see  their  relationship  with  selected  dependent 
variables  such  as  the  merger  of  Extension  and  Research.  Since 
Extension  Organization  depends  upon  the  results  obtained  from  the 
Research  personnel  while  the  Research  Organization  including  the 
University  are  supposed   to  work  on  problems  normally  identified 
by  the  Extension  personnel,  both  Research  and  Extension  Organiza** 
tions  depend  on  each  other.     The  members  employed  in  all  the  three 
organizations,   according  to  their  "status",  perform  certain  "acti- 
vities" coming  under  their  "role  expectations".     To  exist  in  their 
fields  of  specialization  they  must  maintain  their  respective  or- 
ganizations yet  they  must  adopt  to  their  external  environment  - 
to  the  expecr.a tions  of  their  clientele.     Since  Research  and 
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Extenslon  Organizations  have  the  common  objective  of  agricultural 
and  rural  development,   the  efforts  of  these  people  with  varied 
capacities  must  be  integrated,  coordinated  and  "fused"  for  the 
success  of  their  organizations  and  the  satisfaction  of  the  indi- 
viduals concerned. 

Rating  Scale ; 

The  use  of  various  rating  scales  has  been  made  in  many  studies 
related  with  rating  the  importance  of  particular  role/s  and  the 
role's  analysis.     Three  of  the  most  relevant  studies  are  by 
Abdullah  (1964),  Al-Haj   and  Awal   (1969),   and  Al-Haj   and  Hassanullah 
(1969).     The  latter  two  studies  used  a  five-point  rating  scale 
while  the  study  in  view  made  use  of  a  three-point  scale. 

The  respondents  were  asked  to  rate  the  statements  regarding 

the  subject-matter  specialist's  functional  and  organizational 

aspects  as  they  perceived  them  "at  present"  and  "in  future",  on 

a  three-point  scale  ranging  from  1  to  3,     The  scale  was: 

At  present  -  to  what  extent  the  particular 
function  is  being  performed 
at  present: 

1  -  never  or  not  at  all 

2  -  sometimes  or  not  regularly 

3  -  always  or  regularly 

In  future  -  to  what  degree  of  importance  the 
particular  function  is  desirable 
in  future: 

1  -  no  t  important  or  no  need 

2  -  important 

3  -  very  important 

O 
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Later  on,   the  scores  obtained  by  each  role  or  function 
were  summed  up* 

Two  Important  Considerations  About  Rating  Scales : 

Making  arbitrary  decisions  on  selection  of   rhe  "points"  for 
a  rating  scale  Is  not  proper  since  It  may  jeoi)ardlze  the  validity 
of  objectivity  In  rating  the  Importance  of  particular  roles.  Sur- 
prisingly,  this  consideration  may  go  deep  Into  social  and  cultural 
conditions  under  which  a  study  Is  being  conducted*     For  example. 
If  the  respondents  of  an  adult  education  research  study  are  re- 
latively Illiterate,  the  use  of  a  five-point  rating  scale  thus 
spreading  the  Importance  of  a  particular  role  over  five  levels 
will  confuse  the  respondents  in  distinguishing,  for  example, 
among  "ve. y  Important",   "Important",  somewhat  Important",  "not 
so  Important",   and  "not  important"*     This  confusion  in  termn  of 
choice  on  the  part  of  the  respondents  will  result  in  just  hap- 
hazard rating  on  importance  scale* 

The  allotment  of  numerical  values  to  various  degrees  of  im- 
portance in  rating  scale  also  needs  serious  thoughts*     A  d  if f 1- 
cul ty  was  faced  dur Ing  the  s tudy  being  presented  while  the  res- 
pondents,   in  spite  of  their  high  academic  qualifications,  insisted 
on  allotlng  "zero"  to  "never  or  not  at  ail,  and  not  important  or 
no  need"  and  not  "1"  only  because  people  in  West  Pakistan,  in 
general,  consider  only  "zero"  equal  to  "not  at  all"  and  not  "1"* 


Likewise,  different  numerical  figures  may  carry  different  meaning 
in  different  cultures.  ^ 

Concluding  Remarks ; 

Meaningful  dependent  and  independent  variables  can  be  derived 
from  relevant  theories  for  ^mpirical  research  ir   the  field  of 
adult  education.     Rating  scale  is  a  sort  of  technique  between 
sample  survey  and  macrosurvey  and  with  some  precautions  can  be 
used  in  studies  concerning  perceived  importance  of  almost  anything; 
for  example,   roles ,  needs ,   leadership,  program  planning,  cultural 
values,  etc.     This  is  part icula*: ly  helpful  in  underdeveloped  coun- 
tries where  literacy  percentage  is  not  high       Later,  mathematical 
calculations  can  be  made.     This  is  a  possible  solution  to  the 
notorious  slippery  problem  of  quantitative  measuring  of  perceived 
importance • 
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AN^  EXPLORATORY  DESIGN  FOR  THE  STUDY  OF  SUPERVISORY  EFFECTIVENESS 
IN  THi-  EXPANDED  FOOD  AND  NUTRITION  EDUCATION  PROGRAM 

by  Ed  Rapking 

The  rapid  growth  in  the  use  of  paraprofessionals  in  education  has 
led  to  a  number  of  questions  concerning  how  an  organization  can  most 
effectively  utilize  these  new  personnel  to  achieve  desired  outcomes  in 
policy  effectuation.    One  such  question  is  the  amount  and  type  of 
supervision  required  to  maximize  the  effectiveness  of  paraprofessionals. 
This  paper  is  a  discussion  of  the  methodology  used  in  a  study  which  was 
directed  at  the  question  of  what  factors  contribute  to  effectiveness  in 
the  supervision  of  paraprofessionals  in  the  Expanded  Food  and  Nutrition 
Education  Program  (EFNEP)  conducted  by  the  Virginia  Cooperative  Extension 
Service, 

The  initial  review  of  literature  indicated  there  was  little,  if 
any,  research  then  available  dealing  directly  with  the  question  of 
supervision  of  paraprofessionals.     It  also  suggested  that  methods 
traditionally  used  in  the  study  of  supervisory  effectiveness  would  be 
very  difficult  to  apply  in  the  field  conditions  of  the  EFNEP.  One 
limitation  was  the  absence  of  a  clearly  agreed  upon  measure  of  productivity. 
While  the  researcher  could  arbitrarily  define  productivity,  this  would 
leave  a  question  concerning  whether  the  supervisor's  performance  was 
being  measured  by  criteria  different  from  those  he  used  to  set  the  goals 
of  his  own  performance. 

Another  problem  which  emerged  from  the  review  of  literature  was 
the  difficulty  of  selecting  independent  variables  which  would  have 
the  greatest  utility  in  explaining  variation  in  productivity.     It  was 
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concluded  that  the  formulation  of  a  correlational  study  based  only  on 
a  review  of  literature  would  at  best  be  inefficient  and  might  prove 
misleading. 

The  question  was  not  well  formulated,  and  it  appeared  that  the  lir- 
erature  would  not  be  a  sufficient  basis  for  determining  how  to  best 
approach  the  question.    To  treat  all  the  variables  in  the  literature 
would  have  been  impossible  with  the  resources  available.    To  arbitrarily 
select  a  few  of  the  variables  for  intensive  study  would  be  to  risk 
expending  resources  on  trivia. 

Based  on  this  lack  of  previous  research  and  the  desire  to  system- 
atically approach  the  selection  of  variables,  it  was  decided  to  make  the 
study  exploratory.    In  the  exploratory  approach  an  attempt  would  be  made 
to  achieve  a  more  adequate  conceptualization  of  the  question.  Seltiz, 
et.  al.   (1959)  support  the  use  of  exploratory  studies  for  gaining 
"familiarity  with  a  phenomenon,"  achieving  "new  insight,"  formulating 
"a  more  precise  research  problem,"  and  developing  "hypotheses."  For 
this  study  it  was  determined  that  the  purpose  would  be  to  explore  the 
general  question  of  supervisory  effectiveness.    This  exploration  would 
be  used  in  formulating  hypotheses  for  future  testing.    The  exploration 
would  also  be  used  in  developing  some  of  the  conceptual  base  for  the 
hypotheses  which  were  developed. 

Seltiz  et.  al.   (1959,  p.  53)  suggest  three  methods  which  can  be 

utilized  in  an  exploratory  study.    These  include: 

(1)  A  review  of  the  related  social  science  and  other 
pertinent  literature;  (2)  a  survey  of  people  who  have  had 
practical  experience  with  the  problem  to  be  studied;  and 
(3)  an  analysis  of  "insight-stimulating"  examples. 
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This  study  utilized  the  first  two  of  these  methods*    A  review  of 
literature  related  to  the  effectiveness  of  paraprofessionals  suggested 
a  number  of  possible  areas  of  concern  in  supervision.    A  review  of  lit- 
erature in  the  field  of  supervision  yielded  some  possible  areas  of 

interest  for  the  study  of  supervision  of  paraprofessionals.    But,  in 

\ 

each  of  these  areas  of  the  literature  the  findings  were  not  easily 
applied  to  the  specific  question  of  effectiveness  in  the  supervision 
of  paraprofessionals  in  an  educational  program. 

Experience  in  this  study  suggests  that  one  of  the  most  diffic^.lt 
aspects  of  an  exploratory  study  is  the  determination  of  the  level  of 
abstraction  which  will  have  the  maximum  utility  for  the  question 
involved  and  the  resources  available  for  the  study.    To  start  with 
no  conceptual  base  is  to  severely  limit  the  basis  for  asking  questions* 
To  attempt  to  close  the  conceptual  frame  too  tightly  is  to  risk  not 
asking  the  most  important  questions.     In  this  study  the  focus  on 
effectiveness  suggested  that  the  conceptual  basis  of  the  study  be  left 
broad  enough  to  include  a  variety  of  variables.     It  needed  to  take  into 
account  the  psychological,  social,  economic,  and  other  factors  which 
would  influence  the  response  an  employee  would  make  to  a  supervisory 
behavior. 

The  element  of  the  question  which  dedt  with  how  supervision  of 
paraprofessionals  differed  from  the  supervision  of  other  workers 
suggested  some  elements  of  the  study  of  comparative  organizations  as 
a  conceptual  basis.    The  work  of  Etzioni  (1961),  Perrow  (1970),  and 
others  was  of  interest  at  this  stage,  but  it  did  not  lend  itself  to 
the  specific  question  of  supervisory  effectiveness. 


To  cope  with  the  problem  of  a  conceptual  basis  of  the  study,  it  was 
decided  to  organize  the  literature  review  around  three  dimensions  of  the 
supervisor's  work.     These  dimensions  were  found  in  common  to  the  work  of 
Katz  (1955),  and  Bishop  (1969),    They  include;  (1)  the  motivational 
dimension,  dealing  with  the  employee's  willingness  to  contribute  to 
the  achievement  of  organizational  goals;     (2)  the  technical  dimension, 
dealing  with  the  ability  to  utilize  the  relevant  technology;  and  (3)  the 
conceptual  dimension,  which  deals  with  the  ability  to  see  the  organization 
as  a  whole  and  relate  elements  to  each  other  and  to  the  achievement  of 
organizational  objectives.    These  three  dimensions  were  attractive 
because  they  were  broad  enough  to  include  the  total  work  of  the 
supervisor.     They  also  appeared  to  lend  themselves  to  the  more  specific 
kinds  of  conceptualization  which  were  of  interest  to  the  study. 

The  literature  revie*/  was  organized  around  the  three  dimensions 
to  serve  as  the  initial  conceptual  basis  of  the  study.    This  broad 
presentation  of  the  literature  led  to  the  formulation  of  fifteen  research 
questions  for  the  study.    These  questions  were  not  tightly  integrated 
but  represented  areas  of  interest. 

These  research  questions  served  as  a  basis  for  the  development 
of  an  experience  survey.    In  this  survey  an  attempt  was  made  to  draw 
on  the  experiences  of  persons  who  had  worked  with  the  supervision  of 
paraprofessionals  under  field  conditions.    These  persons  would  be 
expected  to  have  accumulated  knowledge  about  what  works  and  does  not 
work  in  supervising  paraprofessionals.    The  purpose  of  this  phase  of 
the  study  was  to  collect  data  from  these  experienced  persons  and  attempt 
to  consolidate  it  in  terms  of  the  literature.    This  experience  survey 


in  combination  with  the  literature  should  serve  as  the  basis  for 
reconceptualizing  the  question  and  formulating  hypotheses  for  future 
testing. 

The  interview  guide  was  selected  as  the  approach  to  data  collection. 
The  research  questions  served  as  the  basis  for  the  formulation  of  ideas 
to  be  covered  by.  the  interviewer.    Unlike  the  interview  schedule,  the 
interview  guide  provides  the  interviewer  flexibility  in  the  wording  of 
questions  and  allows  freedom  to  follow  the  line  of  questioning  which 
is  suggested  by  the  responses  of  an  individual.    It  allows  rephrasing 
when  the  respondent  did  not  understand  the  initial  question,  and  it  lends 
itself  to  a  conversational  style  of  interviewing.    This  allows  the  respond- 
ent to  report  in  language  which  is  comfortable  and  familiar. 

In  the  development  of  the  interview  guide,  the  research  questions 
were  organized  in  an  order  which  would  appear  to  lend  itself  to  a 
conversational  approach  to  the  discussion  of  the  topic.    A  series  of 
inquiries  or  points  to  be  covered  relative  to  each  research  question 
was  then  prepared.    The  organization  and  wording  of  the  guide  was  then 
pretested  and  refined. 

Seltiz  et.  al.  suggest  two  criteria  for  the  selection  of  a  sample 
in  an  experience  survey.    These  are  knowledgability  and  articulateness . 
The  respondent  must  have  had  experience  with  the  phenomena  to  be  studied, 
and  he  must  be  able  to  articulate  his  knowledge  about  these  phenomena. 
Thus,  Seltiz  et.  al.   (1959)  suggest  that  one  of  the  best  methods  for 
the  selection  of  a  sample  would  be  to  ask  knowledgable  administrators 
to  identify  individuals  who  were  both  knowledgable  and  articulate.  It 
must  be  remembered  that  the  search  is  not  for  an  objective  description 
of  what  supervisory  be!         .s  take  place  but  for  insight  into  how 
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supervisory  behaviors  affect  the  behavior  of  paraprofessionals ,  Using 
these  criteria,  administrators  in  the  EFNEP  were  approached  and  asked  to 
identify  supervisors  who  were  knowledgable  and  articulate.  Six 
supervisors  were  selected  to  be  interviewed*    Each  supervisor  was 
ask  to  identify  two  technicians  who  were  knowledgable  and  articulate. 
Tx^elve  technicians  were  thus  selected  for  interviews.    While  this  sample 
may  appear  to  be  small,  it  proved  quite  productive  for  the  purpose  of 
exploration  and  conceptual  development. 

The  interviewer  took  written  notes  during  the  interviews,  and  each 
interview  was  tape  recorded.     Interviews  with  supervisors  lasted  about 
two  hours  each  and  interviews  with  paraprofessionals  lasted  about  one 
hour  each. 

The  sequential  steps  in  the  data  analysis  included  a  summary  of  the 
written  notes,  listening  to  the  tapes,  a  written  conceptualization  of 
findings,  a  review  of  the  written  notes  while  listening  to  the  tapes,  a 
new  summary  based  on  ideas  formulated  in  the  conceptualization7  and  a 
reconceptualization  of  the  findings.    The  findings  and  resultant 
conceptualizations  were  then  used  as  a  basis  for  the  formulation  of 
hypotheses  and  suggestions  for  the  future  study  of  the  question  of 
supervision  in  the  EFTIEP, 

Much  of  the  analysis  consisted  in  reconceptualization  of  the 
questions  raised  in  the  literature  in  terms  of  the  findings  indicated 
in  the  data.     In  some    instances  the  data  suggested  new  areas  of 
questioning  which  are  specific  to  supervision  of  paraprofessionals. 
The  following  summary  of  conceptualizations  which  resulted  from  the 


study  is  offered  to  illustrate  the  utility  of  this  exploratory  approach. 

(1)  Period  of  instability  and  crisis.    When  they  were  employed,  most 
of  the  paraprofessionals  in  the  EFNEP  were  not  prepared  for  the  work  they 
would  do.    They  were  not  technically  trained,  nor  were  they  emotionally 
prepared  for  the  experiences  they  encountered.    They  reported  anxiety 
concerning  their  ability  to  carry  out  tasks,  and  they  reported  emotional 
involvements  with  clients'  problems  which  interfered  with  their  own 
functioning.    The  supervisor's  first  task  appeared  to  be  that  of 
achieving  some  sort  of  stability  in  the  situation.    The  technicians 

had  to  be  trained  in  the  fundamental  skills  needed,  and  they  had  to 
learn  to  differentiate  those  problems  which  could  be  dealt  with  in  an 
educational  program  from  those  which  had  to  be  referred  or  left  alone. 

(2)  Reversal  of  motivational  problems*    Much  of  the  literature  on 
supervision  deals  with  the  motivational  problems  caused  by  uninteresting 
work.    A  reversal  of  this  problem  appeared  to  exist  for  some  supervisors 
of  paraprofessionals  in  the  EFNEP.    The  work  environment  appeared  to  be 
very  stimulating,  and  technicians  were  deeply  involved  in  their  work* 
Technicians  appeared  to  have  a  tendency  to  become  so  involved  that  it 
interfered  with  their  effectiveness. 

(3)  The  data  suggest  that  the  conceptual  content  of  the  supervisor's 
work  IS  higher  in  this  decentralized  program  than  the  literature  suggests 
is  usual  for  first  line  supervisors.    The  supervisor  appeared  to  have 
extensive  responsibilities  for  developing  a  plan  to  utilize  the  resources 
available.    She  was  responsible  for  selection  of  the  individuals  for 
employment  and  designing  a  training  program  to  prepare  them  for  the  work 

to  be  done.    The  supervisor  prepared  the  plan  for.  educational  intervention. 
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evaluated  progress  and  adjusted  plans  in  an  effort  to  develop  the  most 
effective  combination  of  resources  for  the  accomplishment  of  the 
educational  objective. 

The  study  was  noc  limited  to  the  survey  of  independent  variables 
which  might  influence  supervisory  effectiveness.     It  also  dealt  with  the 
question  of  how  supervisors  and  paraprofessionals  defined  effectiveness 
and  productivity.    Methods  of  data  collection  were  explored  in  the 
practical  context  of  persons  who  had  experience  observing  and  interviewing 
clients. 

An  unanticipated  finding  was  the  discovery  of  a  number  of  conditioning 
variables  which  would  appear  to  have  a  great  impact  on  comparability  of 
data  between  supervisors  in  different  political  and  geographical  areas. 
These  included  cultural  variables  which  appear  to  affect  how  clients  will 
respond  to  different  kinds  of  educational  intervention,  economic  variables 
which  affect  what  clients  have  to  work  with  to  change  their  diet,  and 
policy  variables  which  operate  independent  of  educational  programs.  The 
magnitude  of  these  kinds  of  variables  led  to  a  serious  question  of  the 
utility  of  educational  outcomes  as  a  measure  of  supervisory  effectiveness 
when- comparing  work  in  different  counties  or  cities.    As  a  result  of 
these  findings,  it  was  suggested  that  the  question  of  what  supervisory 
behaviors  lead  to  increased  educational  outcomes  be  deferred  in  favor 
of  more  limited  questions.    Two  such  questions  include (1)  what  kinds  of 
paraprofessional  behaviors  lead  to  desired  educational  outcomes  in 
specific  situations,  and(2)what  kinds  of  supervisory  behaviors  lead  to 
desired  paraprofessional  behaviors. 


Throughout  this  study  the  emphasis  was  on  the  formulation  of  questions 
rather  than  on  the  determination  of  conclusions  about  the  effectiveness 
of  supervisory  behaviors.    As  a  practical  matter,  however,  it  should 
also  be  noted  that  the  exploratory  methodology  utilized  in  this  study 
can  also  serve  as  a  basis  for  a  more  informed  approach  to  supervisory 
practices.    The  combination  of  an  intensive  review  of  literature  and 
a  survey  of  persons  who  have  practical  experience  working  with  a 
phenomenon  should  provide  a  better  basis  for  understanding  that 
phenomenon  than  existed  without  such  a  study.    While  this  method  does 
not  provide  the  measurement  required  for  hypothesis  testing,  it  does 
provide  a  level  of  data  greater  than  is  otherwise  available  for  decision 
making  on  many  applied  questions  confronted  by  educational  administrators. 

The  relative  economy  of  the  experience  survey,  as  used  in  this 
study,  suggests  it  as  an  approach  to  many  of  the  applied  questions 
confronted  in  the  operation  of  an  organization.    This  systematic  survey 
of  the  experiences  of  organization  members,  when  integrated  with  a 
conceptual  development  of  the  problems  involved,  could  be  utilized  as 
a  very  important  feed-back  mechanism  for  an  organization. 

The  broad  scope  of  the  question  of  supervisory  effectiveness,  the 
lack  of  previous  research  on  the  supervision  of  paraprofessionals ,  and 
the  resources  available  led  to  the  selection  of  an  exploratory  methodology 
for  the  study  of  supervision  of  paraprofessionals  in  the  EFNEP.  A 
combination  of  a  review  of  literature  and  an  experience  survey  were 
used  to  explore  the  question  and  formulate  hypotheses  for  future  testing. 
The  study  was  productive  in  isolating  certain  variable^   /hich  showed 
the  greatest  promise  for  future  study.    It  also  yielded  information  which 
would  be  useful  in  the  design  of  future  studies. 
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Scientific  rescQrch  is  the  creation  of  knowledge.  At  its  best  it  describes  o  reality 
thot  we  con  agree  upon  and  that  we  ccn  sest  according  to  rother  specific  and  stringent 
criteria.  It  is  the  best  neons  that  Western  man  has  devised  for  undurstanding-  ihat  is, 
predicting  and  controlling— his  world.  Scientific  research  tells  o$  something  about  oor 
world  that  we  didn't  know  before  we  did  the  work. 

Scientific  research  is  also  a  strategy  for  problem  solving.  It  has  a  methodojogical 
component  which  is  composed  of  sets  of  techniques  for  inventing  questions  and  answers 
and  for  testing  the  usefulness  of  both.  As  many  hove  loid  before,  more  than  half  of  the 
job  of  good  problem  solving  and  scientific  reseorch  is  to  identify  the  problems  or  the 
questions  c«.  well  as  the  answers. 

CREATIVITY  AND  PROBLEM  SOLVING  IN  EDUCATIONAL  RESEARCH 

We  don't  seem  to  apply  very  well  the  processes  of  creativity,  problem  solving, 
and  scientific  reseorch  to  the  problems  in  education  in  general  and  adult  education  in 
specific.  As  educational  researchers  we  seem  very  concerned  about  being  scientific. 
A  common  mistake  we  seem  to  moke  in  our  striving  for  this  lofty  goal  is  to  think  of  the 
scientist  as  being  on  extremely  rigorous  practitioner  of  a  few  well  defined  skills,  including 
experimentation,  data  collection  and  analysis,  and  the  public  report  of  the  process  and 
findings  of  his  work.  I  think  we  forget  much  too  easily  that  a  very  important  port  of  the 
scientist's  role  is  to  be  a  free,  open,  responding,  receptiv  artist.  Both  in  the  approach 
he  takes  to  finding  and  solving  problems  and  to  the  aesthetic  kick  that  he  gets  from  the 
products  he  produces  in  the  laboratory,  in  the  field,  or  in  the  armchair.  At  the  risk  cf 
being  too  bold  about  it,  I  would  like  to  suggest  that  on  some  very  important  points,  good 
science  is  good  art.  One  of  the  points  on  which  science  and  art  agree  is  the  extent  to 


which  both  work  from  general  abstracHons  about  the  phenomena  of  interest  in  a  given 
part  of  the  world.  This  abstract  generality— an  idea,  if  you  will—is  a  seminal  theory* 
Theory  spawns  creativity  for  both  the  scientist  and  the  artist. 

I  think  we  can  show  how  a  theory  may  be  used  to  facilitate  research  in  adult 
education.  Before  we  do  that,  let's  consider  for  a  moment  some  recent  work  in  the  area 
of  innovation  in  higher  education  and  some  work  in  the  area  of  creativity  in  general . 
For  the  last  eight  years  the  Big  Ten  universities  and  the  University  of  Chicago  have 
participated  in  a  consortium  concerned  with  identifying  and  sharing  instructional  innovation. 
Stanford  C.  Ericksen  (Center  for  Research  on  Learning  and  Teaching  at  the  University  of 
Michigan)  has  participated  with  this  group  and  acted  as  editor  for  a  publication  of  abstracts 
of  the  innovations  found  in  the  participating  schools.  Professor  Ericksen  has  recently 
reviewed  241  abstracts  collected  over  the  last  eigh.  years  and  has  attempted  to  characterize 
trends  and  patterns  associated  with  thesejnnovations.  The  findings  would  probably  confirm 
some  of  our  first  expectations,  innovations  occurred  at  all  levels  of  instruction,  from 
undergraduate  to  graduate,  and  in  all  areas  of  curriculum.  A  great  percentage  of  innovations 
involved  the  application  of  technological  aids  to  instruction  or  some  instructional  rearrange- 
ments generally  tending  toward  individualizing  instruction.  In  sum,  the  innovations  reported 
tended  to  be  the  application  of  a  technological  aid  to  the  problem  of  providing  information 
to  a  greater  number  of  students  or  an  attempt  to  rearrange  the  leorning  situations  so  that 
the  amount  of  learning  required  of  the  student  at  any  point  in  time  in  a  given  system  of 
instruction  could  be  better  controlled  to  meet  the  needs  of  the  student.  NAost  of  the  innovations 
seemed  to  be  trial  and  error  responses  to  perceived  problems.  They  are  not  high  conceptualized 
procedures  developed  on  a  basis  of  a  consistent  theory  of  how  people  learn  or  how  they  ore 
to  be  instructed. 


If  we  think  of  these  reported  innovations  as  the  products  of  some  creative  process 
responding  to  systems  of  instruction  in  higher  education  and  adult  education,  it  would  seem 
that  the  results  of  the  process  are  responses  of  limited  effect  on  short-range  problems. 
Unless  someone  con  suggest  that  instruction  in  higher  education  has  changed  fundan  sntally 
in  the  last  decade,  then  such  a  critique  of  at  least  one  sample  of  innovation  seems  justified. 
Recent  summaries  of  research  and  innovation  in  higher  education  (see  Trovers,  1973)  support 
this  general  conclusion. 

Most  products  of  innovation  in  college  teaching  seem  to  be  the  result  of  an 
incomplete  process  of  creativity  relying  heavily  on  a  cognitively  primitive  trial  and  error 
approach.  Implicit,  unarticulated,  and  incomplete  models  of  how  man  learns  and  is  to  be 
instructed  are  behind  the  products  produced.  The  approach  is  contrary  to  our  knowledge 
which  suggests  that  problem  solving  should  proceed  through  stages  of:  (1)  abundant,  cognitive 
input  including  theoretical  perspectives;  (2)  application  of  relevant  and  available  technologica 
ind  performance  skills  in  the  problem  field;  \3)  intense  motivation  by  the  worker  to  bring 
materials  and  tools  together  on  the  problem;  and  finally  (4)  cognitive  incubation  during 
which  the  problem  solver  withdraws  conscious  effort  to  allow  spontaneovs  processes  to  work 
on  the  problem.  In  many  instances,  potential  solutions  are  generated  with  li  tie  attention 
from  the  worker  after  this  period  of  work. 

The  procedures  we  have  used  to  solve  our  problems  in  teaching  in  higher  education 
do  not  seem  consistent  with  this  model  of  creativity.  The  application  of  a  technological 
aid  to  an  ongoing  system  of  instruction  (a  frequent  innovati  >n)  often  results  in  the  misuse 
of  the  medium  and  the  assumption  that  we  know  what  college  teaching  and  adult  learning 
are  all  about,  and  all  we  have  to  do  is  figure  out  how  to  do  it  on  a  TV  screen  or  on  a 
computer  terminal.  A  second  frequent  response  we  have  is  precipitated  by  specific  critical 


incidents  or  crises,  it  involves  identifying  a  mispractice  or  other  problem  and  then  findins 
ir  some  rrial-and-error  fashion  a  specific  solution  to  the  situation.  Usually  we  oxplain 
after  the  fact  why  our  innovation  is  an  adequate  solution.  In  effect,  we  rationalize  what 
we  have  developed^  A  good  example  of  this  is  the  creation  of  the  multiple-choice 
examination,  which  was  obviously  a  response  to  the  need  to  have  an  economic,  apparently 
objective  testing  instrument  applicable  to  a  lai^  number  of  students.  But  the  creation 
has  no  conceptual  base  suggesting  that  it  is  an  adequate  way  to  aid  the  student  in  retrieving 
and  disploying  learning  thot  hos  occurred. 

Almost  every  professionol  group  hos  responded  similorly  to  the  pressures  for  change 
in  problem  solving.  When  confixMited  with  clients  and  with  problems  Yfhich  are  large  and 
complicated  in  affecting  human  welfare,  rapid  and  practical  solutions  are  sought  anJ  rewarded. 
But  any  professional  group  thot  continues  to  proceed  in  this  fashion  and  only  in  this  fashion 
will  be  prone  to  the  fads  and  the  embarrossments  of  short-term  end  unpredictable  solutions. 
Innovations  and  changes  should  emanate  from  well  articuloted,  conceptual  poso.ons. 
Thoughtful,  theoretical  positions  on  how  people  learn  and  how  they  should  be  instructed 
and  the  testing  of  these  positions  by  meaningful,  scientific  procedures  should  produce 
important  informotion  in  higher  educotion  in  general  and  in  adult  education  in  specific. 
What  I  am  soying,  I  hope,  is  the  following: 

(1)  Let's  not  do  "dumb  empirical  research"  or  {ust  plain  empirical  research  in 
adult  education,  because  it  has  failed  elsewhere  in  the  social  sciences  so 
embarrassingly; 

(2)  Let's  generate  testoble  theories  about  the  exciting  area  of  adult  and  lifetime 
looming  and  seize  the  opportunity  ot  hand  to  throw  some  very  important  light 
on  this  long  neglected  humon  experience; 


(3)  Let's  stay  in  touch  with  our  insights  and  feelings  and  with  eoch  other  as 
problem  solvers,  researchers,  innovators,  agents  of  change  in  this  finoliy- 
beginning-to-grow  area  and  realize  that  while  we  may  aspire  to  lofty  goals 
of  science,  we  may  have  very  few  of  the  means  to  generate  and  solve  the 
problems  of  adult  learning  from  the  procedures  now  available  to  us  from 
the  physical  and  social  sciences. 

RIGOR,  RELEVANCE,  SCIENCE 

I  would  like  to  spend  a  moment  on  another  point  about  something  else  that,  in 
addition  to  lack  of  theory,  gets  in  the  way  of  our  creativi^/-rand  that  is,  a  value  system 
that  places  primary  emphasis  on  what  is  often  colled  rigor.  Scientific  researchers  aspire 
to  rigor  in  their  work  and  educational  researchers  concerned  so  very  much  about  a  scientific 
solution  to  their  problems  ore  concerned  with  rigor  even  more  so  than  the  ordinary.  I  would 
guess  that  the  true  meaning  of  rigor  is  that  one  has  a  nonequivocal  answer  to  one's  problems 
and  has  a  high  degree  of  precision  and  control  over  the  phenomenon  he  is  studying.  It 
would  be  difficult  to  argue  against  such  a  value,  but  I  would  like  to  suggest  that  the 
emphasis  on  the  value  of  rigor  might  be  out  of  place  in  our  work  in  research  in  adult 
3Cucation  and  in  education  in  general  and  probably  in  most  of  ihe  social  sciences. 

'  remember  confronting  the  problem  of  rigor  in  scientific  research  as  a  graduate 
student,  when  I  was  introduced  to  a  paper  published  in  1962  in  the  American  Scientist  by 
one  of  my  professors,  who  was  teaching  me  clinical  psychology  at  the  time.  The  paper  is 
entitled  'The  Behavioral  Psychologist  at  a  Choice  Point"  (Marks  and  Seeman,  1962).  It 
is  the  story  of  a  white  rat  who  wanted  to  become  a  psychologist  and  who  was  admitted  to 
graduate  study  in  thot  field.  Herman  noted  quickly  as  a  graduate  student  thot  some  reseorch 
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was  thought  to  be  more  important  or  more  prestigious  than  some  other  !;inds  of  research 
within  the  area  of  psychology.  And  it  became  clear  to  him  that  one  of  the  factors 
determining  the  prestige  value  of  research  was  its  rigor.  But  it  also  became  very  clear 
to  Herman  that  rigor  was  relative  and  that  if  it  v/ere  the  only  criterion  determining  what 
problems  were  to  be  worked  on,  then  everyone  would  work  on  physics  and  no  one  wo«»ld 
work  on  education.  Rigor  wos  not  the  only  consideration  although  it  often  seemed  to  be 
the  tail  that  wagged  the  dog  or  the  rat,  if  you  like. 

Further  investigation  led  Herman  to  discover  that  interest  or  relevance  was 
another  important  factor.  Choices  for  research  problems  by  researchers  were  made  on 
the  basis  of  the  interest  or  relevance  or  importance  of  the  problem  as  well  as  the  rigor 
with  which  the  problem  could  be  studied.  Herman  wanted  so  much  to  be  a  scientist,  but 
not  a  scientist  studying  molecules  or  atoms  or  machines  on  inclined  planes,  but  a  scientist 
studying  the  behavior  of  humans.  And  the  paradox  and  the  dilemma  that  confronted  Herman 
was  the  fact  that  there  seemed  to  be  an  inverse  relationship  between  meaningful  problems 
and  the  amount  of  rigor  with  which  the  problem  could  be  studied.  Herman  felt  that  others 
had  made  implicit  choices  as  they  confronted  the  dilemma  that  he  now  perceived  and  in 

most  instances  had  chosen  to  study  the  problem  that  could  be  attacked  most  rigorously 
rather  than  to  «*jdy  the  problem  that  was  the  most  interesting  or  most  important  or  most 
relevant.  For  the  psychologist  studying  learning  it  meant  studying  the  learning  of  nonsense 
syliobles  in  the  laboratory  rather  than  the  study  of  middle-aged  adults  in  the  real  world. 
As  adult  education  researchers  become  more  and  more  concerned  about  identifying  and 
solving  problems  in  this  burgeoning  field,  it  seems  that  they  must  confront  that  choice  point 
and  decide  how  to  strike  a  bokince  between  the  relevance,  importance  and  interest  of  the 
problem  they  attack  and  the  rigor  they  will  be  allo^yed  to  apply  to  that  problem.  Incidentally, 

ERIC 


the  conclusion  that  rigor  and  importance  are  inversely  related  was  professionally  fatal 
for  Herman  in  that  he  was  asked  to  leave  graduate  school.  So,  take  my  warning  if  yoo 
too  choose  to  contradict  the  prevoiling  value  system  in  scientific  research. 

It  wasn't  lonq  n«  r  |  met  Herman  and  worked  that  dilemma  out  for  myself  that 
it  became  clear  to  me  that  those  persons  making  significant  breakthroughs  in  the  social 
sciences,  people  making  great  contributions  toward  research  in  understanding  human 
behavior,  were  those  persons  who  not  only  challenged  the  traditional  value  of  rigor  in 
scientific  research  as  applied  to  the  types  of  problems  studied,  but  v.Iso  challenged  the 
met-iods  used  in  attacking  the  new  problems  selected.  The  Harvard  psychologist,  B.  F. 
Skinner,  who  has  had  so  much  influence  on  how  we  think  about  human  performance  and 
learning  performed  experiments  on  single  subjects  and  refused  to.perform  complex,  if  any, 
statistical  analyses  at  a  time  when  such  work  in  the  science  of  learning  and  experimental 
psychology  was  heretical.  -Similarly,  the  Swiss  philosopher  and  developmentalist,  Jean 
Piaget,  studied  his  own  children  in  very  informal  but  intense  interview  situations  to  derive 
a  very  co»nplex  series  of  hypotheses  about  cognitive  develop  lent  and  cognitive  functioning. 
Where  othere  were  studying  children  in  groups  applying  rigorous  controls  on  narrow  pieces 
of  b;!^  /ior  and  trying  tc  flush  out  statistically  sigt.  icant  but  otherwise  not  very  interesting 
differences  between  groups,  Piaget  was  poking  into  the  universal  mechanisms  of  the  mind 
in  his  own  kitchen.  Piaget's  research  is  an  outstanding  example  of  work  which  resulted 
in  the  production  of  heuristic  hypotheses  and  a  vast  and  broad  theoretical  network  to  be 
researched  and  applied  to  educational  problems  for  a  long  time  to  come.  He  helped  us  to 
think  of  the  problems  of  cognitive  development  and  gave  us  the  means  by  which  we  might 
attempt  to  find  arewers  to  these  problems.  There  are  other  examples  of  this  style  of  high- 
risk  but  incredibly  insightful  research,  but  let  these  two  I  have  mentioned  serve  as  landmarks 
for  the  adult  education  researcher. 
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KINDS  OF  THEORIES 

To  this  point  I  hope  I  have  suggested  the  importance  of  a  creative  approach 
and  a  theoretical  perspective  to  scientific  research  in  adult  education,  i  hope  also  that 
I  have  offered  a  useful  caveat  to  ward  off  the  demon  rigor  as  we  attack  exciting  problems 
in  human  learning  end  development.  For  the  remainder  of  my  poper  I  would  like  to 
concen«  jte  on  some  applications  of  theory  to  research.  There  are  at  least  two  sources 
of  theoretical  input  useful  for  the  practitioner  or  researcher  in  adult  education  interested 
in  proposing  and  testing  innovations.  The  first  of  these  consists  of  the  human  behavior 
theories  in  the  social  sciences.    The  second  is  much  less  familiar  and  constitutes  the 
source  of  cognitive  tools  called  theories  of  instruction. 

A  useful  example  of  the  first  category  is  reinforcement  theory,  resulting  from 
the  work  of  B.  F.  Skinner  at  Harvard.  Reinforcement  theory  suggests  that  feedback  to 
the  learner  and  conscque'     *  after  overt  performance  are  important  factors  in  producing 
leorning.  This  position  suggests  that  the  learner  must  perform  in  order  to  iearn  and  that 
his  performances  must  be  contingent  with  what  he  perceives  to  be  appropriate  payoff. 
The  theory  predicts  that  little  generalized  and  transferred  learning  will  occur  when  the 
learner  is  required  merely  to  sit  and  listen  to  the  presentation  of  information.  This  learning 
theory  is  also  very  concerned  with  individual  differences  among  learners  and  suggests  thot 
arrangements  be  made  in  instructional  systems  so  that  each  learner  has  the  opportunity  to 
respond  at  his  own  rate  and  to  •^aceive  those  reinforcers  that  are  meaningful  to  him.  The 
lecture  an^  discussion  group  are  thought  to  be  relatively  ineffective  methods  of  instruction, 
according  to  this  theoretical  stance. 

An  oltemative  to  the  lecture  ond  group  discussion  i$  offered  as  a  result  of  the 
work  of  Fred  S.  Keller's  system  of  personolized  instruction  and  mastery  learning.  Taking 


the  fundamental  suggestlom  of  reinforcement  theory^  Professor  Keller  and  his  associates 
suggested  that  learning  might  proceed  much  more  effectively  if  individuals  were  allowed 
to  proceed  at  their  own  rate  through  small  units  of  material  •  Clearly  specified  and 
written  ob{ectives  are  shared  with  the  learner  and  with  his  own  personal  tutor.  Lectures 
are  minimized  as  a  mode  of  presenting  information  to  the  learner  and  are  instead  used 
to  motivate  students  to  learn  the  content  presented     him  through  other  means.  Tutors 
that  work  with  learners  in  a  Keller-designed  course  are  usually  undergraduate  students 
who  have  previously  mastered  the  course  and  who  are  supervised  by  the  instructor  and 
guided  by  sufficient  written  information.  Mastery  learning  is  achieved  by  allowing  the 
student  to  take  tests  on  given  units  of  material  until  he  shows  that  he  has  attained  the 
objectives  set  for  hsm.  This  is  where  the  individuolizotion  (with  respect  to  rate  of 
learning)  occurs,  in  that  a  student  is  allowed  to  take  as  much  time  or  as  little  time  as 
he  needs  to  master  a  given  unit  '>f  material.  He  is  given  continuous  feedback  about  his 
performance  through  both  the  written  materials  and  the  individual  contact  from  his  tutor. 
He  apparently  receives  substantiol  omounts  of  reinforcement  from  observing  how  closely 
he  achieves  the  objectives  set  for  him  and  the  social  recognition  that  results  from  such 
achievement. 

Reinforcement  i^heory  may  be  applied  in  other  ways  than  through  the  personalized 
instructional  system  developed  by  Keller  and  his  associates.  Whereas  there  is  no  isomorphic 
correspondence  between  the  theory  and  the  system  of  instruction  developed,  it  is  very  clear 
that  the  Keller  Pic   procedures  are  consistent  with  reinforcement  theory. 

Reinforcement  theory  has  suggested  o  course-wide  procedure  for  producing  learning. 
Other  theories  from  the  social  sciences  may  not  specify  o  course-wide  instructional  innovation 

/ 
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or  change,  but  may  instead  suggest  smaller  procedural  innovations  within  a  more  conventiona 
format.  Attribution  *heory,  as  described  by  Harold  Kelly,  may  be  an  example  of  a  new 
theory  thu.  can  make  specific  recommendations  about  a  set  of  behaviors  which  apply  across 
various  instructional  designs.  The  theory  is  concerned  with  on  individual's  determination 
of  the  reasons  and  responsibility  for  his  behavior.  One  of  the  major  theorems  is  concerned 
with  the  extent  to  which  an  individual  may  disavow  his  own  responsibility  for  a  given 
piece  of  troublesome  behavior.  If  an  individual  can  attribute  the  reason  for  his  behavior 
to  some  external  force,  he  is  not  likely  to  take  responsibility  for  that  behavior  and  under 
some  circumstances  will  reject  the  behavior  at  the  earliest  opportunity.  The  theory  needs 
much  more  substantiation  from  social  science  research,  but  if  the  hypotheses  that  it  leads 
us  to  generate  in  our  practices  in  higher  education  are  supported,  this  theoretical  position 
suggests  that  some  of  our  coercive  and  direc' ve  procedures  in  teaching  produce  exactly 
the  opposite  effects  from  what  the  typical  professor  desires.  Attribution  theory  may  lead 
us  to  search  out  procedures  for  producing  learning  whi  h  allow  the  learner  to  moke  more 
choices  and  to  take  more  responsibility  for  what  he  learns.  Such  a  position  does  not 
suggest  that  we  merely  discard  all  structure  and  regulations  that  we  now  have,  but  instead 
that  we  adjust  the  instructional  system  in  such  a  way  that  our  interpersonal  relationships 
allow  for  meaningful  decision-making  for  all  of  the  participants.  How  accountable  a 
student  is  in  a  given  situotioh  Ohd  how  much  choice  he  has  about  wkit  and  how  he  will 
learn  are  important  factors  to  be  considered  in  whatever  innovations  or  changes  we 
contemplate.  How  these  factors  interact  with  teaching  procedures  may  be  a  question 
attribution  theory  can  help  u$  answer.  Raising  these  issues,  as  attribution  theory  leads  us 
to  do,  is  an  example  of  how  theory  can  help  us  find  questions  as  well  as  answers. 
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Theories  of  instruction  are  less  easy  to  identify  than  the  behavior  theories  of 
the  social  sciences.  The  psychologist  Jerome  Bruner  is  responsible  for  recent  interest  in 
the  notion  of  a  theory  of  instruction.  He  has  pointed  out  '^xit  while  theories  of  -earning 
describe  processes  of  learning  (probably  intra-individual)  a  theory  of  instruction  could 
prescribe  the  means  by  which  a  given  piece  of  learning  could  be  achieved.  That  is, 
a  theory  of  instruction  would  tell  us  how  to  proceed  if  we  wanted  to  attain  a  given 
Instructional  objective.  When  we  use  theories  of  behavior,  we  tend  to  derive  a  number 
of  practices  that  a  specific  theory  suggests.  As  Bruner  conceptualized  it,  a  theory  of 
instruction  would  be  a  much  more  explicit  set  of  rules  which  would  determine  the  limits 
within  which  one  would  have  to  operate  to  produce  learning  in  humans.  Some  macro- 
theories  of  instruction  have  been  attempted  and  at  the  present  time  comprise  general 
statements  of  the  factors  which  are  Importunt  in  producing  various  learning  objectives 
and  a  specification  of  the  extent  to  which  those  factors  are  prevalent  in  various  Instructional 
designs.  A  consideration  of  a  variety  of  Instructional  designs  differing  with  respect  to  the 
roles  of  the  participants  and  the  effective  factors  prevalent  and  related  to  various  learning 
outcomes  has  one  great  advantage  for  the  practitioner  attempting  to  produce  innovation 
and  change.  It  aids  In  overcoming  the  narrow  thinking  usually  associated  with  what  con- 
stitutes college  teaching.  College  teaching  becomes  much  more  than  just  one  person 
presenting  Information  to  another  person  or  to  a  group  and  instead  comes  to  mean  a  vast 
array  of  behaviors  and  procedures  differentially  associated  with  and  useful  for  an  equally 
wide  array  of  objectives. 
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TOWARD  A  THEORY  OF  INSTRUCTION 

We  need  a  theory  of  instruction  to  suggest  to  us  alternative  strategies  which 
are  available  to  us  as  researchers  and  practitioners  attempting  to  achieve  a  variety  of 
learning  objectives.  Such  a  theory,  I  believe,  as  Bruner  (1966)  suggested,  will  indicate 
and  prescribe  for  us  the  conditions  under  which  we  miqht  expect  the  learning  we  desire 
to  occur.  Such  a  theory  made  explicit  and  designed  to  overcome  the  implicit  assumptions 
currently  victimizing  us,  will  provide  a  framework  in  which  teaching  and  learning 
effectiveness  may  be  evaluated  as  a  function  of  a  number  of  variables  other  than  the 
conditions  of  the  lecture  format.  As  long  as  we  suggest  changes  in  our  practice  within 
the  context  of  what  we  consider  to  be  "standard"  college  teaching,  I  believe  little 
progress  v/iii  be  made  in  changing  the  fundamental  strategies  we  have  and  use. 

A  student  educationol  reformist^  once  suggested  that  promoting  educational 
change  in  institutions  of  h?gher  education,  if  done  in  a  piecemeal  fashion,  is  very  similar 
to  poking  a  mars  hma  I  low— no  matter  how  hard  one  pokes  ultimately  the  marshmallow  returns 
to  its  original  sh^pe.  Anticipating  such  problems  in  researching  changing  instructionol 
'  practice,  especially  in  adult  education,  st  has  been  fr.y  intention  in  devising  the  sc' -^me 
I  would  like  to  present  to  you  now,  to  work  at  somewhat  of  a  macro  level.  I  am  interested 
in  changing  and  evaluating  educational  practice  and  providing  the  means  for  making 
decisions  in  educational  change  at  at  least  the  courso-wide  level.  To  change  or  suggest 
sub-procedures,  methods  of  techniques  Within  the  traditional  format  of  the  lecture  tends 
to  perpetuate  the  potition  that  college  teaching  h  ^ome  uni-dimension  and  homogeneous 
enterprise  and  has  some  conventional  and  traditional  format  which  must  be  maintoined. 


Ira  Magaziner,  Brown  University  student  presenting  at  Oakland  University, 

1969. 
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For  this  reason  I  would  like  to  suggest  that  we  consider  the  basic  units  of  our  educational 
practice  to  be  course-wide  designs. 

An  instructional  design  may  be  considered  any  course-wide  -ystem  of  procedures 
aimed  at  producing  learning.  Designs  are  to  be  ultimately  defined  and  differ  with  respect 
to  the  specific  roles  of  the  participants.  In  the  instructional  situation  ^he  roles  of  the 
student  and  teacher  define  and  characterize  one  design  and  differentiate  it  fTO,t,  another. 
In  Table  1,  six  relatively  common  designs  are  listed.  As  you  can  see  from  the  list  it  is 
noi  my  intention  to  ignore  or  discredit  entirely  the  lecture  as  a  legitimate  instructional 
design.  It  is,  however,  considered  to  be  only  one  of  a  set  of  designs  available  to  the 
instructor.  I  would  maintain  that  the  role  of  the  teacher  and  the  role  of  the  students  is 
very  different  in  a  design  called  the  Lecture  versus  one  called  Small  Group  Discussion 
or  one  called  the  Oxford  Tutorial .  In  Table  2  in  a  very  brief  fashion  I've  tried  to 
characterize  the  roles  of  instructor  and  student  and  to  suggest  that  they  are  different  per 
instructional  arrangement.  In  the  Lecture  situation  the  instructor  or  professor  plays  a  very 
octive  role  of  presenter  of  information,  speaker  and  of  impersonal  grader  of  the  students. 
On  the  other  hand,  the  student  plays  a  much  less  active  role,  mu'.t  be  quite  adept  at 
listening  and  encoding  information  in  the  audial  mode.  By  contrast,  in  the  Keller  Plan 
situation,  the  instructor  may  not  lecture  at  all  and  instead  finds  himself  in  the  position 
of  designing  materials  to  carry  the  information-presentation  load,  into  being  somewhat 
of  a  personnel  director  in  supervising  proctors  and  assistants  who  work  on  an  individual 
basis  with  students  who  are  active  problem-solvers  and  explorers  working  their  way  through 
units  of  material  with  specified  objectives  and  with  some  options  in  how  to  get  to  these 
obiectives.  Finally,  on  ihe  point  that  designs  are  defirad  by  different  roles  for  participants, 
let  me  suggest  to  yoo  that  althooflh  we  think  of  independent  study  or  some  tutorial  work 
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we  may  do  as  equivalent  to  an  Oxford  Tutorial  design,  I  would  submit  that  the  Oxford 
Tutorial  involves  a  very  definite  set  of  ground  rules,  skills  and  responsibilities  for  rrH> 
don  and  the  student  and  is  in  many  respect*  qui/e  different  from  what  the  American  system 
of  independent  study  would  suggest.  I  would  also  suggest  that  the  behaviors  defining 
the  roles  '>f  the  participants  in  most  design^  are  rather  complex  and  that  the  effectiveness 
of  the  participants  would  be  greatly  enhanced  if  they  did,  in  fact,  first  acquire  the  haoits 
and  behaviors  necessary  to  excel  in  the  instructional  design  in  which  they  operate. 
Something  as  apparently  innone  and  innocuous  as  conducting  a  small  group  discussion 
is  an  horrendously  complex  and  involved  task  v.hich  mo«f  of  us  will  attempt  with  little  or 
no  training  in  our  guise  as  college  teachers.  It  is  furthermore  quite  a  different  kettle  of 
fish  to  conduct  effectively  a  small  group  discussion  design,  rather  than  a  lecture  although 
I'm  sure  you  have  observed  as  i  have  as  I  walked  through  the  halls  of  my  institution,  my 
astute  colleagues  lecturing  to  one  or  two  or  five  students  in  what  was  originally  touted 
as  a  class  to  be  conducted  on  the  small  group  discussion  formot. 

The  six  designs  I  have  identified  comprise  by  no  means  on  exhaustive  list.  I  wish 
only  to  suggest  to  you  that  these  alternative  strategies  for  instructional  practice  are  ovaiial 
to  us  and  that  they  do  differ  in  very  meaningful  ways  in  terms  of  what  the  participants  do 
in  the  roles  they  hold.  I  submit  to  you  that  more  of  the  variance  in  teacher  effectiveness 
is  accounted  for  by  the  design  used  than  by  the  extent  to  which  a  given  teacher  can 
expertly  apply  a  design. 

The  arious  designs  we  have  available  to  us  ore  more  or  less  effective  depending 
on  the  objective*  we  hove  for  the  learning  system  we  ore  operating.  In  Table  3  I  have 
listed  $ome  (once  again  not  an  exhaustive  list)  of  the  objectives  or  desired  outcomes  we 


may  have  for  college  and  adult  education  courses «  I  am  in  full  agreement  with  those  who 
maintain  that  the  teocher  must  specify  as  concretely  as  possible  in  behavioral  terms  ex/uctly 
what  he  hopes  to  achieve  in  a  given  course  of  instruction «  I  have  identified  the  desired 
outcomes  in  Table  3  onSy  in  order  to  locate  various  creos  of  achievement  and  not  tc  specify 
in  any  concrete  way  exactly  what  is  to  be  achieved.  A  fundamental  thesis  in  my  scheme 
is  that  there  is  a  relationship  between  the  extent  to  which  certain  outcomes  will  be  achieved 
and  the  design  applied  in  the  instructionol  system.  For  some  desired  outcomes,  some  designs 
are  more  effective  than  others.  To  apply  a  single  design  to  all  outcomes  is,  of  best, 
incomplete. 

Designs  vary  in  their  effectiveness  for  ^iven  desired  outcornss  because  they  facilitate 
learning  as  a  function  of  ulfferent  factors  intrinsic  to  them.  In  Table  4  I  hove  listed  once 
again  only  some  apparently  effective  factors  related  to  behavioral  change  and  learning 
in  general.  Each  of  these  factors  can  be  highly  specif'  <1,  operationally  defined  and 
empirically  measured  and  hopefully  show"  to  vary  as  o  function  of  the  insrructiono'  desipn. 
For  most  of  the  factors  there  is  some  theoretical  rat*  ^nole  or  experimental  evidence  that 
the  concept  can  account  for  some  behavioral  change.  For  example,  the  list  contnlns  the 
variable,  "the  amount  of  reinforcement  available  tc  the  learner,"  as  an  effective  factor 
producing  learning  olong  the  lines  of  soine  desired  outcome.  This  factor  has  emerged  as 
effective  from  the  work  in  Skinnerion  psychology,  cperan.'  conditioning  and  behavior 
modificati   i.  Also,  factor  number  seven  suggests,  tho^  the  amount  of  opportunity  to  behave 
coruistently  with  new  attitudes  is  a  conceptually  sound  way  of  thinking  about  ottitude  change 
which  has  emerged  from  Festinger's  Cognitive  Dissonance  Theory  ond  work  in  Skinnerian 
behovior  modification •  Some  other  factors  such  os  the  amount  of  choice  for  be  learnt  r 
ond  the  opportunity  for  the  instructor  to  profess  are  less  well  founded  os  to  their  evfectiveness 
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irt  producing  change  in  instructional  systems,  but  have  eioerged  as  very  interesting 
hypotheses  in  this  area.  It  is  sufficient  for  my  purposes  at  this  point  and  also  for  the 
purposes  of  the  practitioner  and  researcher  in  adult  education  to  consider  these  factors 
as  possible  intervening  variables  tying  together  designs  which  can  be  used  to  produce 
certain  desired  outcomes.  I  am  interested  in  the  scheme  at  this  point  primarily  because 
it  is,  at  least  theoretically,  testable  and  relationships  between  designs  available  and 
outcomes  desired. 

Let  me  suggest  just  a  few  of  the  possible  relationships  between  desired  outcomes 
and  instructional  design  as  a  function  of  amount  of  the  effective  factor  available  across 
designs.  In  Figure  1  I  have  suggested  thot  the  instructor  seeks  the  desired  outcome  of 
attitude  change.  We  have  some  evidence  to  suggest  that  attitude  change  may  occur  as 
a  function  of  the  extent  to  which  the  learner  behaves  in  a  manner  consistent  with  new 
attitudes.  The  desired  outcome  of  attitude  change  will  occur  to  the  extent  that  the  amount 
of  the  effective  factor  is  operative  in  the  various  designs.  Speculation  is  that  the  design 
giving  the  most  opportunity  to  behave  consistently  with  new  attitudes  is  Simulation  and 
the  design  with  the  least  amount  of  the  effective  factor  is  the  Lecture.  The  relationship 
and  the  hypotheses  are  testable.  The  outcome  of  the  designs  in  terms  of  the  desired  outcome 
of  attitude  change  can  be  assessed  and  correlated  with  the  amount  of  the  effective  factor. 
If  there  is  any  logic  to  the  hypothetical  relationship  laid  out  here,  ;t  means  for  the 
practitioner  that  there  are  various  ways  to  be  more  or  less  effective  in  producing  this 
outcome  depending  on  the  designs  that  he  can  use  in  his  instructional  system,  in  Figure  2 
the  order  of  effectiveness  of  the  various  designs,  for  another  desired  outcome  (proficiency 
in  motor  skills)  is  somewhat  different  because  the  presumed  effective  factor  (the  amount  of 
reinforced  practice)  is  different.  Among  the  other  designs  available  the  Oxford  Tutorial 
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and  Keller  Plan  are  high  on  the  list  of  effective  designs  to  produce  proficiency  in  motor 
skills.  A  Programmed  Reading  System  (P.R.SO  where  the  student  would  work  his  woy 
through  frames  in  a  reading  text  and  a  Lecture  or  Small  Group  Discussion  design  are 
'  considered  generally  ineffective  in  producing  this  desired  outcome.  Once  again,  the 

relationship  is  testpble  and  offers  options  and  alternatives  to  the  proctitioner  and  researcher. 
Of  the  two  relationships  that  we've  looked  at  so  far,  the  traditional  design  of  Lecture  is 
relatively  low  in  terms  of  its  effectiveness  in  producing  the  two  desired  outcomes  suggested, 
i  should  suggest  at  this  point  that  the  determination  of  how  much  of  the  factor  exists  in 
the  given  'design  and  how  much  of  a  relationship  there  is  between  that  factor  and  the 
desired  outcome  is  a  matter  of  great  speculation.  This  does  not  trouble  me  at  this  time 
if  I  can  make  the  point  that  such  speculations  and  variability  and  options  ore  available 
to  the  practicing  instructor  as  he  attempts  to  achieve  effectiveness  and  to  the  reseorcher 
as  he  attempts  to  achieve  insight  and  understanding.  For  our  concerns  here  today,  when 
we  attempt  to  measure  teacher-effectiveness  I  wish  to  emphasize  the  point  that  the  context 
in  which  that  measurement  is  taken  is  crucial,  especially  as  it  relates  to  tha  design  th.ct 
the  instructor  is  using  and  the  outcomes  he  is  attempting  to  achieve.  In  a  full  report  of 
my  scheme  at  least  ten  such  relationships  have  been  identified  end  are  considered  to  be  ^ 
at  least  reasonoble  and  testable.  (Figures  3*10  attached  are  graphs  of  these  remaining 
relationships.)  Of  course,  for  each  desired  outcome  that  one  can  identify  if  there  is  any 
indication  of  what  factor  or  factors  ore  related  to  that  outcome,  such  a  relationship  across 
designs  may  be  hypothesized. 

in  order  to  simplify  my  scheme,  1  hove  proceeded  by  assuming  that  only  linear 
relationships  exist  between  factors,  designs  and  outcomes »  More  complex  relationships 
are  more  likely  ond  would  hopefully  be  disclosed.  Furthermore,  for  any  given  instructor 
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or  program  more  than  a  single  outcome  Is  often  desired  for  u  given  course  of  Study.  We 
most  often  want  to  simultaneously  achieve  many  outcomes.  For  various  outcomes  it  seems 
reasonable  that  more  than  one  effective  factor  is  involved  in  producing  a  given  outcome. 
So  ultimately  the  scheme  we  have  to  devise  is  one  which  will  coordinate  multiple  outcomes 
with  multiple  effective  factors.  The  theoretical  system  in  which  we  work  will  then  have 
at  one  level,  a  factors-by-outcomes  matrix  (slide)  where  we  have  determined  that  certain 
factors  are  related  to  certain  outcomes  and  then  secondly  a  factor$-by-designs  matrix 
(slide)  in  which  we  sliow  that  those  effective  factors  we  have  identified  are  distributed 
differentially  across  the  various  designs  we  have  available  to  us.  We  then  will  have  to 
consider  an  outcomes-by-designs  matrix  (slide)  in  which  various  designs  are  identified 
as  more  or  less  effective  in  producing  various  outcomes.  Such  a  matrix,  then,  can  be 
used  when  the  instructor  finds  himself  at  a  choice  point  in  selecting  a  given  course  of 
instruction.  (Examples  of  these  matrices  are  attached.) 

!  think  to  this  point  I  have  identified  a  scheme  where  I  can  point  out  to  the 
instructor  that  he  has  available  to  him  alternate  designs  or  approaches  to  use  in  promoting 
learning.  What  is  necessary  after  we  have  identified  the  designs  is  to  establish  the 
relationship  between  the  effective  factors  as  they  exist  in  those  designs  and  to  show  that 
some  are  more  effective  than  others  in  producing  various  desired  outcomes.  And  then  I 
think  we  are  truly  on  the  verge  of  a  theory  of  instruction,  because  at  some  point  it  will 
become  apparent  that  some  outcomes  or  some  combinations  of  desired  outcomes  cannot 
be  reasonably  achieved  by  the  designs  available  or  thot  some  newly  formulated  effective 
factor  is  not  clearly  operative  in  the  available  designs  and  new  ptocedures  quo  designs 
must  be  invented.  For  example,  if  an  instructor  suggests  that  this  desired  outcomes  involve 
soma  creativity,  some  development  of  clinical  insight  and  a  high  degree  of  motor  skill  and 
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we  know  that  the  effective  factors  relating  to  these  outcomes  involve  reinforcement, 
practice,  modeling  and  some  opportunity  to  behave  consistently  with  new  attitudes, 
asking  our  scheme  what  design  combines  these  factors  in  some  optimal  way  to  produce 
these  outcomes  may  result  in  the  answer  that  no  such  design  exists  today.  And  then  our 
task  would  seem  to  be  to  combine  these  factors  in  some  way  so  that  our  role  and  the  roie 
of  the  student  would  emerge  and  be  different  from  roles  in  other  designs  and  produce  for 
us  o  new  effective  strategy  of  instruction. 

I  have  presented  this  scheme  from  the  standpoint  of  the  instructor  or  professor 
who  is  empowered  to  identify  desired  outcomes  and  to  make  choices  with  respect  to 
instructional  design,  i  realize  that  this  is  a  one-sided  approach  to  the  problem  and  that 
desired  outcomes  can  and  perhaps  should  be  determined  by  the  student  participant  at  least 
in  con  junction  with  the  instructor.  This  concern  is  important,  I  am  sure.  If  one  Is  attempting 
i  to  optimize  learning.  It  moy  be  a  central  issue  In  the  area  of  adult  education. 

The  scheme  I  propose  here  has  resulted  in  some  meaningful  research  activity  on 
my  own  part.  The  concepts  of  students'  perceptions  of  the  choice  available  to  them  in 
various  instructional  arrangements  and  their  perceptions  of  their  accountability  in  these 
systems  have  emerged  as  relevant  factors  heretofore  insufficiently  researched.  I  hove 
developed  scales  (attached)  hoped  to  measure  choice  and  accountability  and  hove  some 
preliminary  reliobility  estimates  that  are  very  encouraging.  It  would  seem  reasonable  to 
hypothesize  that  these  factors  vary  as  a  function  of  instructional  designs  and  are  differentially 
related  to  various  instructional  outcomes.  If  adult  teaming  Is  different  from  learning  In 
other  groups,  such  differences  moy  emerge  In  an  interaction  with  these  concepts  of  choice 
and  accountobility> 
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My  scheme  t$  a  very  general  one  and  was  designed  to  consider  the  macro  issues 
in  higher  education  and  not  to  emphasize  the  specific  concerns  of  special  areas  like 
adult  education.  There  are  unique  issues  relative  to  adult  education  and  highly  specialized 
theoretical  positions  should  be  developed  to  stimulate  thinking  and  research  in  these 
special  problems.  Issues  such  as  adult  education  for  mid-life  career  changes  and  learning- 
as--therapy  in  geronroiogicai  programs  need  to  be  given  the  creative-theoretical  treatment 
I  have  suggested  today.  Similarly,  technologicoi  advances  which  may  facilitote  life-long 
learning  in  a  Learning  Society  must  be  considered  in  some  conceptual  framework  that  will 
lead  to  rich  concepts  for  learner,  teacher  and  researcher  • 


•     TABLE  1 

<^nMF  iNSTRjiCTIONAL  DESIGNS 


I  •  Lecture 

2.  Small  Group  Discussion 

3.  Kel ler  Plan 
H.  Simulation 

5,  Programmed  Reading  System 

6,  Oxford  Tutorial 


ROLES  IN  INf^TRllCTIQNAI  DESIGNS 


DESIGN 


mi 

INSTRUCTOR  STUDENT 


LECTURE 


SPEAKER , 
GRADER . 


LISTENER, 
READER . 


S.G.  DISCUSS'.  COORDINATOR,  TALKER, 

FACILITATOR.  OBSERVER. 


KELLER  PLAN 


MATERIALS,  PROBLEM- 
SUPERVISOR,  SOLVER, 
CONSULTANT.  EXPLORER. 


SIMULATION 


DESIGNER, 
ACTOR, 
OBSERVER..  . 


ACTOR, 
OBSERVER. 


P.R.S. 


MATERIALS,  READER, 
CONSULTANT.  FRAME-SOLVER 


OXFORD  TUT. 


ASSIGNER, 
LISTENER. 


READER, 
SPEAKER. 


SOME  DESIRED  OUTCOy.ES 

L.  Mastery  of  cognitive  content 

2.  Production  of  independent  learners 

3.  Facilitation  of  creativity 
Production  of  social  activists 

5.  Mastery  of  skills  of  scholarship 

6.  Transfer  of  knowledge  to  practical 
qpp I i  cat  i  on 

7.  The  generation  of  hypothses 

8.  Self-actualization  of  student 

7.  Development  of  communication  skill 

10. Attitude  and  value  change 

I  I .Devel opment  of  motor  skills 

*l2.Devel  opment  of  clinical  ability 

13. Happiness  of  the  instructor 

IH. Happiness  of  the  student 

15. Economic  solvency  of  the  course 


Ef^FECTlVE  FACTORS  [N  INSTRUCTIONAL  DESIGNS 

1.  Activity  level  of  the  learner 

2.  Amount  of  reinforcement  avoiloble 
to  learner 

.3.    Amount  of  learner-teacher  contact 
^.    Timing  of  feedback  to  learner 

5.  Accountability  of  learner 

6.  Amount  of  opportunity  to  practice 
new  responses 

7.  Amount  of  opportunity  to  behave  consistent 
with  new  attitudes 

8..   Learner's  perception  of  the  probability 
of  success 

9.  Amount  of  exposure  to  new  stimuli 

10.  Instructor, student  ratio 

11.  Personality  characteristics  of  teacher 

12.  Learning  style  of  student 

13.  Communications  skills  of  teacher 
IH.  Amount  of  choice  for  learner 

15.  Opportunity  for  .instructor  to  profess 
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FIG'.l.  EFFECTIVE  FACTOR:  AMOUNT 
OF  OPPORTUNITY  TO  BEHAVE  CONSIST 
ENTLY  WITH  NEW  ATTITUDES. 
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FIG. 2.  EFFECTIVE  FACTOR :AMLJNT  OF 
REINFORCED  PRACTICE  OF  MOTOR  SKILLS. 
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FIC.3.  EFFECTIVE  FACTOR:  AMOUNT 
OF  REINFORCED  PRACTICE  OF  SKILLS. 


FIG.H.  EFFECTIVE  FACTOR -.EFFORT 
NEEDED  TO  EXCELL  IN  COURSE. 
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FIG.  5.  EFFECTIVE. FACTOR:AMOUNT- 
OF  LEARNER-TEACHER  CONTACT. 
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FIG.  6  .EFFECTIVE  FACTOR:  AMOUNT 
OF  CHOICE  OF  LEARNER. 


FIG. 7  .EFFECTIVE  FACTOR :LEARN£R'S 
ACCOUNTABILITY.       '  . 
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S.G.  DISCUSSION 
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P.R.S 

FIG.  8  .  EFFECTIVE  FACTOR;OPPOR 
TUNITY  TO.  PROFESS. 
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FiS.lO.  EFFECTIVE  FACTOR:LEARNER'S 
PERCEPTION  OF  PROBABILITY  OF  SUCESS. 
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A  HEURISTIC  MODEL  OF  ORGANIZATION  DEVELOPMENT 

By 

William  C.  Smith     Associate  Professor 
East  Carolina  University 

Kerllnger  (1964)  defines  the  heuristic  method  of  science  as  a  dynamic 
activity^  of  what  scientists  do  as  opposed  to  a  static  method  that  contri- 
butes systematized  information  to  the  world*    In  the  heuristic  view  the 
present  state  of  knowledge  is  Important »  but  it  is  Important  primarily 
because  it  is  a  basis  for  further  scientific  theory  and  research*  In 
other  words t  the  heuristic  view  in  science  emphasizes  problem-^olving 
rather  than  facts  and  bodies  of  information  alone* 

Tolman  (1951»  p*  283)  in  attempting  to  delineate  a  heuristic  design 
suggests  that  it  is  a  pragmatic  working  model  and  can  "be  defended  only 
insofar  as  it  proves  helpful  in  explaining  and  making  understandable  al- 
ready observed  behavior  and  insofar  as  it  also  suggests  new  behaviors  to 
be  looked  for."   Tolman's  approach  is  somewhat  consistent  with  Bruner  (1961) 
who  envisioned  a  "heuristic  of  inquiry"  which  has  to  do  with  the  process 
of  trying  to  find  out  something*    Re  argues  that  he  has  never  seen  anyone 
improve  in  the  art  and  technique  of  inquiry  by  any  means  other  than  en» 
gaging  in  inquiry* 

Emmeshed  too  in  the  concept  is  the  notion  succinctly  expressed  by 
Riley  (1963)  who  distinguishes  two  main  phases  of  the  basic  research  process* 
One»  an  empirical  phase  in  which  the  researcher  is  led  by  ideas  and  theories 
to  certain  facts»  and  second^  by  an  interpretative  phase »  in  which  the  re- 
searcher compares  these  facts  with  his  initial  ideas  and  theories  and  hence 
tries  to  understand  their  larger  significance* 

The  research  process  is  diagrammed  by  Riley  (p*  A)  thusly: 
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Figure  1.    Diagram  of  the  research  process 


A  heuristic  model*  or  the  developmental  process  of  a  heuristic  model* 
using  Riley's  framework  would*  therefore,  move  from  a  conceptualization  of 
existing  models,  by  way  of  an  appropriate  interpretative  design  to  the 
literature,  back  to  a  newly  constructed  conceptual  model. 

The  discussion  which  follows  utilizes  this  framework. 
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The  Conceptual  Model 

The  5y?jot:  purposes  of  the  study  were  to  (i)  examine  existing  behavioral 
science  literature  and  research  findings  about  organization  and»  utilizing 
an  exploratory  design,  develop  a  heuristic  model  to  portray  the  process  of 
organizational  growth  and  development  and  (2)  specify  impl^.cations  of  the 
model  which  would  provide  change  agents  with  suggested  methods  for  Imple* 
menting  change  efforts.    The  underlying  rationale  for  the  study  was  the 
notion  that  the  scientific  research  process  wotdd  enable  the  researcher  to 
bring  together  for  comparison  specific  facts  from  the  real  world  of  con-* 
Crete  social  phenomena »  on  the  one  hand*  and  corresponding  ideas  and  pro^ 
positions  from  the  behavioral  sciences  on  the  other.    In  this  manner,  the 
researcher  sought  clues  to  the  understanding  of  organizational  growth  and 
development  and  insights  for  developing  hypotheses. 

An  exploratory  study  leading  to  insights  must  be  regarded  as  simply 
a  first  step  of  the  scientific  method.  Later,  more  carefully  controlled 
studies  are  needed  to  test  empirically  whether  the  insights  that  emerged 
have  general  applicability. 

As  an  exploratory  study,  the  investigation  exhibited  two  well  de-* 
fined  aspects:    (1)  interpreting  research  findings  frcm  the  behavioral 
sciences  and  organization  theory  allows  one  to  generate  new  theoretical 
positions;  and  (2)  specifying  Implications  of  the  model  might  be  generali- 
zed to  more  adequate  program  development. 

The  study  began  with  a  basic  definition  of  Organization  Development, 
hereinafter  referred  to  as  0  D,  as  an  effort  (1)  planned,  (2)  organization 
wide,  and  (3)  managed  from  the  top,  to  (4)  increase  organizational  effective- 
ness and  health  through  (5)  plaoned  interventions  in  the  organizations 
"processes",  using  behavioral-^sdence  knowledge.  (Beckhard) 
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The  criteria  for  examining  conceptual  change  models  were  concerned 

with: 

1.  Accounting  for  the  stability  and  continuity  in  events  and  account-- 
ing  for  change  in  them. 

2.  The  source  of  change  in  the  model. 

3.  Accounting  for  goals  and  directions  that  are  intended* 

A.    Providing  levers  or  handles  for  affecting  the  direction ,  tempo , 

and  quality  of  the  change  processes. 
5.    The  place  and  role  of  the  change  agent. 

Selected  models  of  OD  were  reviewed  and  compared  against  these  criteria. 
The  number  of  models  examined  vere  confined  to  representative  types  rather 
than  an  exhaustive  review  of  all  models. 

Three  models  identified  by  Bennis  (1963)  and  a  similar  listing  by 
Chin  (1969)  provided  a  frame  of  reference  for  analyzing  efforts  of  the 
utilization  of  knowledge  in  effecting  organizational  change*    One  approach » 
termed  as  a  "socio-therapeutic"  or  "equilibriimi"  approach,  is  associated 
with  the  Tavistock  Institute  and  the  work  of  Jaques  (1951),  Menzies  (1960), 
and  Sofer  (1962).    The  second  and  third  approaches  are  associated  with  the 
National  Training  Laboratories  where  practicing  social  scientists  have 
applied  principles  and  techniques  of  social  psychology  to  organizations. 
An  "organic"  theory  of  change  is  illustrated  primarily  by  the  ideas  of 
Blake  and  Mouton  (1964),  Shepard  and  Blake  (1962),  and  Bennis  (1966).  The 
third  approach,  based  on  the  ideas  of  Argyris  (1962)  and  Chin  and  Benne 
(1969),  was  referred  to  as  a  "developmental"  model. 


To  this  framework  was  added  yet  another  model  —  that  by  Gordon  Lippitt 
(1969),  termed  a  "situational  confrontation"  model.    While  this  model  in- 
corporates many  of  the  elements  and  features  of  the  models  identified  by 
Bennis  and  Chin,  its  approach  is  different  and  it  provides  yet  another 
dimension  to  the  growing  process  of  OD. 

The  four  models  utilized  represent  varying  conceptualizations  of 
organizational  change  utilizing  educational  strategies.    The  equilibrium 
model  emphasizes  stability.    Change  evolves  out  of  tensions  and  conflicts 
in  the  system.    The  model  assumes  organization,  Interdependency,  and  inte-- 
gration  among  its  parts  and  that  change  is  a  derived  consequence  of  "exact- 
ness of  fit"  between  parts  of  the  system  or  between  the  system  and  other 
surrounding  and  interacting  systems.    The  sources  of  change  derive  from 
structure,  structural  stress  and  strain  externally  induced  or  in- 

ternally created.    The  mechanism  for  change  is  therefore  tension  release 
through  anxiety  reduction.  Change  goals  in  the  equllibriura  model  are 
associated  with  organizational  survival  and,  therefore,  take  on  the  values 
of  vested  interest.    The  targets  of  change  efforts  are  system  stresses  and 
strains  (interfacing  situations),  and  change  agents  generally  utilize 
psychotherapy  of  some  form  of  clinical  experience  to  address  perceived 
difficulty  in  functioning. 

The  organic  model  exhibits  a  teleological  and  organismlc  bias  in  the 
manner  in  which  the  whole  is  related  to  its  parts.    Because  its  basic 
strategy  implies  system  integration,  the  approaches  generally  utilized 
are  problem-solving  and  team  development.    The  source  of  change  relates  to 
systemic  power  distribution  and  conflict  situations.    System  in^rovement 
is,  therefore,  concerned  with  the  redistribution  of  power  and  conflict 
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I  resolution.    The  direction  of  change  in  the  organic  model  is  cyclic  in 

nature,  and  this  direction  is  enhanced  by  member  collaboration  and  adaption. 

I  The  target  of  change  is  the  problem-solving  activities  of  an  organization, 

and  the  normative  goal  is  the  improvement  of  organizational  culture.  The 
change  agent  is  generally  a  trainer^ teacher  in  a  role  external  to  the  sys- 
tem. 

>  The  developmental  model  assumes  continual  change  and  development, 

i^. e^. ,  the  growth  and/or  decay  of  a  system  over  time.    Stability  at  any  given 
time  is  a  "snapshot"  of  a  living  process,  a  state  that  will  give  way  to 
another  state.    Since  change  is  rooted  in  the  very  nature  of  living  organ- 
isms   there  is  the  supposition  that  change  is  "natural."    The  laws  of  the 
developmental  process  are  not  necessarily  fixed  (CHiln,  1969,  p.  310),  and 
"some  effects  of  environment  are  presumably  necessary  to  the  developmental 
process."    Since  the  direction  of  change  is  considered  "built-in"  and 
natural,  it  is  moving  toward  some  goal,  the  fulfillment  of  its  destiny, 
granting  no  major  blockage.    Intervention  by  the  change  agent  is  viewed  as 
the  removal  of  blockage  and  helping  clients  to  develop  and  maintain  authen- 
tic relatio  ships.    Approaches  utilized  are  generally  T-group  or  other 
problem-solving  activities. 

The  fourth  model,  a  sttuatlonal-confrontation  model,  is  a  combination 
of  the  other  three  models.    The  model  is  based  on  the  idea  that  organiza- 
tions have  stages  of  potential  growth  and  that  they  continually  experience 
crises  and  situations  demanding  certain  responses  that  are  indispensable 
if  the  organization  is  to  achieve  its  next  stage  of  growth.  Stability 
follows  a  developmental  conceptualization  which  is  a  time-slice  of  a  living 
process — a  stage  that  leads  to  growth  or  decay.    Positive  change  or  renewal 
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in  Lippitt's  terms,  however,  is  not  natural.    Following  organic  notions, 
it  must  be  induced  through  interfacing  processes  of  dialogue,  confronta- 
tion, search,  and  coping.    The  direction  of  change  is  toward  the  greater 
goal  of  developmental  maturity.    Interim  goals  reflect  survival  and  equi- 
librium.   The  situational-confrontation  model  differs  from  the  other  ap- 
proaches in  its  conception  of  the  role  of  the  change  agent  (renewal  stimu- 
lator).   In  this  approach  the  change  agent  is  considered  a  part  of  the 
internal  organization,  although  an  external  role  Is  not  discounted.  The 
other  models  consider  the  change  agent  as  researcher,  trainer,  or  consul- 
tant, and  generally  external  to  the  client-system. 

These  four  models  are  developed  around  three  educational  formats — 
training,  consultation,  and  survey  feedback.    Although  these  strategies  are 
not  conceptually  discrete  forms  and,  in  practice,  are  variously  permuted 
and  combined,  they  provide  a  review  of  relevant  models  and  form  the  basis 
for  the  development  of  a  new  model. 

METHODOLOGY 

This  study  did  not  test  specific  hypotheses.    It  was  intended,  rather, 
to  provide  insights  into  the  current  phenomenon  of  OD  which  may  be  empiri- 
cally tested  by  subsequent  studies.    Thus,  an  exploratory  study  which 
Searches  for  the  broader  meaning  of  existing  research  generates  new  theore- 
tical positions.    The  present  study  was  limited  to  that  purpose. 

The  primary  emphasis  in  the  research  methodology  was  placed  on  iden- 
tifying, defining,  and  categorizing  certain  properties  found  in  varying 
approaches  to  planned  organizational  change.    By  starting  with  a  quantita- 
tive analysis,  which  allowed  the  researcher  to  classify  the  significant 
elements  in  the  literature  about  organizations,  it   was  possible  to  ad- 
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vance  systematically  to  another  means  of  analysis — qtxalitative  analysis* 
Qualitative  descriptions  in  this  study  served  the  purpose  of  dealing  with 
organizations  as  a  "whole"  social  system  rather  than  isolated  aspects  or 
selected  parts  of  wholes.    The  research »  in  other  words,  began  the  study 
with  a  loosely  defined  conceptual  model  and  an  exploratory  objective. 
In  this  manner,  all  the  variables  analyzed  were  treated  as  explanatory  or 
potentially  explanatory.    By  this  process,  available  OD  data  were  followed 
in  order  to  discover  which  variables  may  prove  relevant  to  the  new  model 
and  how  they  may  be  interrelated. 

The  scheme  for  analysis  and  the  concep  s  it  generated  were  not  ini- 
tially precise;  rather,  exploration  was  based  on  available  models  in  an 
attempt  to  generate  data  and  elaborate  on  them  for  what  Merton  (1957,  p. 
108)  termed  the  "recasting  of  theory."    A  tentative  model  was  developed  as 
a  heuristic  device  to  serve    and  guide  the  formultaion  and  solution  of 
organizational  problems.    It  was  a  working  model,  tentative,  and  a  way  of 
constructing  a  particular  set  of  social  phenomena.    The  researcher  was 
therefore  able  to  review  and  revise  it  in  the  light  of  the  evidence  ob- 
tained. 

The  principal  research  methodology  employed  in  this  study  was  the 
analysis  of  the  literature  about  organization  by  a  variation  of  the  tech- 
nique of  content  analysis.    The  purpose  was  to  classify  the  significant 
elements  in  OD  on  the  basis  of  a  tentative  conceptual  design  and  to  learn 
how  these  elements  could  be  operationalized  by  professional  change  agents 
working  collaboratively  with  client  system  members. 

The  cases  for  this  study  included  a  large  number  of  studies  drawn 
from  a  variety  of  different  kinds  of  organizational  settings.    The  cases 
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represented  multidiaclpllnary  efforts,  particularly  sociology,  psychology, 
administrative  science,  and  organization.    Each  case  was  compared  against 
the  fundamental  dimensions  of  change  as  developed  in  a  scheme  for  analysis. 
The  guidelines  by  which  research  findings  were  analyzed  involved  the  fol- 
lowing criteria:    (1)  accounting  for  stability  and  continuity  in  organiza- 
tions, and  accounting  for  change  in  them;  (2)  determining  the  source  of 
change;  (3)    determining  forces  affecting  the  direction,  tempo,  and 
quality  of  change  processes;  (4)  determining  goals  and  direction  of  change 
efforts;  and  (5)  principal  parties  (behavioral  units)  involved.  In  addi- 
tion to  these  items,  the  researcher  was  also  interested  in  basic  informa- 
tion about  the  nature  of  the  environmental  settings  and  the  type  of  organi- 
zational system. 

From  this  preliminary  search,  whether  or  not  the  cases  met  the  cri- 
teria spelled  out  in  the  scheme  was  determined.    Cases  were  included  if 
they  contained  the  following  variables:    a  change  agent,  a  client  system, 
organizational  diagnosis,  a  planning  strategy,  and/or  consequences  of 
change  efforts. 

A  basic  premise  of  the  research  approach,  following  Jones  (1968), 
was  that  if  a  substantial  number  of  references  that  contained  the  fore- 
going variables  could  be  amassed  and  analyzed,  it  would  be  possible  to 
formulate  generalizations  about  the  subject  and  conceptually  arrange 
these  generalizations  and  the  variables  therein  into  a  heuristic  model 
(Table  2).    Sixty- two  of  the  cases  were  from  scholarly  Journals,  cover- 
ing a  variety  of  disciplines.    The  Harvard  Business  Review,  the  Adminis- 
trative  Science  Quarterly,  and  the  American  Sociological  Review  accounted 
for  24  cases.    Another  166  cases,  several  of  which  were  book  length,  were 
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secured.    Monographs  provided  8  cases,  and  another  16  were  secured  from 
miscellaneous  sources  such  as  magazines,  unpublished  material,  government 
documents,  and  special  ca8e**preparatlon  programs. 

Scope  and  Umitatlons  of  the  Study 
A  limitation  of  the  design  was  the  utilization  of  available  data. 
First,  the  data  were  not  originally  assembled  for  present  purposes,  and 
some  were  often  lncoin>lete  or  In  a  form  not  readily  adaptable.  Second, 
reliability  was  difficult  to  establish.    Planning  strategies,  for  Ins- 
tance, could  not  be  reproduced  nor  could  the  participants  be  questioned. 
Finally,  some  of  the  data  were  In  a  form  that  did  not  fit  present  defini- 
tion of  the  concepts.    Thus,  the  study  re! led  heavily  on  the  judgment  of 
the  researcher. 

The  conceptual  design  of  this  study  rested  upon  the  premise  that 
planned  organizational  change  develops  through  the  conscious,  deliberate, 
and  planned  efforts  of  some  person,  group,  or  organizational  unit  and  a 
change  agent  working  collaboratively  toward  derived  goals.    In  other 
words,  the  objective  of  change  efforts  was  seen  to  be  the  improved  perfor- 
mance and  operation  of  organizational  systems  (client  systems)  utilizing 
appropriate  knowledge  and  social  technology. 
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Table  1:    Sources  of  cases  on  planned  organizational  change 


Source  Number  of  cases 


Journals : 


Adult  Education  1 

Administrative  Science  Quarterly  8 

American  Journal  of  Orthopsychiatry  1 

American  Psychologist  1 

American  Sociological  Review  5 

California  Management  Revlev  2 

Comaunity  Mental  Health  Journal  2 

Education  Quarterly  1 

Harvard  Business  Review  11 

Human  Organization  (fonaerly  Applied  Anthropology)  2 

Human  Relations  3 

Journal  of  Abnormal  Social  Psychology  3 

Journal  of  Applied  Behavioral  Science  2 

Journal  of  Applied  Psychology  1 

Journal  of  Secondary  Education  1 

Journal  of  Social  Issues  2 

Kansas  Business  Review  1 

Management  Review  1 

Management  Science  1 

Personnel  1 

Personnel  Administration  4 

Personnel  Journal  1 

Progressive  Education  1 

Psychological  Review  1 

Rural  Sociology  1 

Social  Forces  1 

Social  Services  Review  1 

Training  and  Development  Journal  2 

Books  166 

Monographs  8 

Miscellaneous  16 


Grand  Total   252 
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The  concept  of  planned  organizational  change  cdopted  vas  a  program 
of  self-study  and  action,  rather  than  to  provide  a  plausible  description 
of  varying  organizational  acconqplishments.    Involved  in  the  design  were 
mutual  goal-setting  by  parties  in  the  change,  experience-based  learning, 
and  a  specific  planning  strategy. 

Organizational  change  was  limited  to  the  utilization  of  knowledge 
as  a  basis  for  change.    The  three  educational  strategies  incorporated  in 
the  design  were  (1)  education  and  training,  (2)  consultation,  and  (3) 
survey  feedback.    Organizational  change  brought  about  by  extreme  means 
of  force,  terror,  or  coercion  was  not  considered.    Neither  did  the  design 
consider  natural  change,  except  by  reference,  since  no  apparent  conscious- 
ness, deliberativeness,  or  goal-setting  occurs. 

The  conceptual  design  viewed  organizations  as  being  In  social  equili- 
brium, and  planned  change  as  a  new  state  of  equilibrium  for  the  proper 
functioning  of  the  system.    All  the  significant  components  of  the  system 
are  in  support  of  each  other.    In  this  state,  subsystems  in  the  organiza- 
tion are  more  able  to  find  psychological  security  because  of  the  absence 
and/or  reconciliation  of  conflicting  attitudes,  values,  and  beliefs. 
Built  into  the  change  state  is  a  tendency  toward  movement,  growth,  and 
development.    The  concepts  of  adaption  and  resistance  to  change  and  the 
consequences  of  change  were,  therefore,  draim  upon  for  explanation. 

Research  Findings 

Five  major  elements  were  found  to  be  involved  in  most  change  processes 
and  provided  a  basic  construct  for  the  development  of  the  heuristic  model. 
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In  other  words »  five  measurable  features  of  groups  were  identified 
in  the  Heuristic  Model  which  should  vary  with  the  organization's  ability 
to  collect  valid  data,  feed  it  back  to  the  appropriate  individuals,  and 
develop  action  planning  on  the  basis  of  the  data*    These  variables  are: 
1*    Their  orientation  toward  identification  of  organizational 

mission  and  values* 
2.    Leadership  styles,  either  flexible  or  rigid* 
3*    The  ability  to  utilize  experience-based  behavior* 
4*    The  degree  of  openness  of  communication  systems* 
5*    Their  orientation  toward  collaboration  and  conflict* 

Interpretation 

Following  Zetterberg*8  (1963)  technique  of  developing  axiomatic  theo- 
ries, these  variables  in  the  Heuristic  Model  are  related  in  the  following 
ways: 

1*    The  greater  the  orientation  toward  open  communication,  the  greater 
the  ability  to  utilize  experience-based  behavior* 

2*    The  greater  the  flexibility  of  leadership,  the    reater  the  orien- 
tation toward  identification  of  mission  and  values* 

3*    The  greater  the  orientation  toward  identification  of  mission  and 
values,  the  greater  the  ability  to  utilize  experience-based  be- 
havior* 

4*    The  greater  the  ability  to  utilize  experience-based  behavior,  the 

less  the  orientation  toward  conflict* 
5*    Tlie  greater  the  orientation  toward  open  communications,  the  less 

the  orientation  toward  conflict* 


6*    The  greater  the  orientation  toward  identification  of  nission  and 
values »  the  less  the  orientation  toward  conflict. 

1.    The  greater  the  orientation  toward  open  connnuiiication8»  the 
greater  the  flexibility  of  leadership. 

8.  The  greater  the  flexibility  of  leadership,  the  greater  the 
ability  to  utilize  expericnce-based  behavior. 

9.  The  greater  the  orientation  toward  identification  of  mission  and 
values*  the  greater  the  orientation  toward  open  communication. 

10.    The  greater  the  flexibility  of  leadership,  the  less  the  orien- 
tation toward  conflict. 

The  linkages  between  determinant  and  result  in  these  propositions 
are  assumed  to  be  stochastic. 

If  the  last  four  findings  are  selected  as  propositions*  the  other 
findings  thus  become  theorems.    Together*  the  four  major  propositions  and 
the  six  theorems  represent  all  the  possible  two-variable  relationships ^ 
when  order  does  not  make  a  difference.    The  resulting  10  hypotheses  expli- 
cate all  the  interrelationships  of  this  system  of  5  variables*  making  re- 
search easier. 

Operatlonallzlng  the  Model 
Because  the  planning  process  is  central  in  OD*  a  detailed  description 
of  the  process  was  undertaken «    The  asumptlons  and  concepts  developed  in 
the  Heuristic  Model  were  incorporated  into  the  description  of  how  the  pro-* 
cess  works. 

System  changes  In  each  of  the  change  models  reviewed  take  the  form 
of  problem-solving.    In  each  model*  the  adiievement  of  optimum  reality 
orientation  depends  on  the  system*  s  ability  to  adapt  to  its  changing  inter- 
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nal  and  external  environments*    In  0D»  intervention  is  the  gu5.dance  of  the 
organization  in  developing  and  institutionalising  its  own  problem-solving 
structures  and  processes.    The  structures  and  processes  oust  take  into 
consideration  both  the  human  problems*  or  relationships  and  morale*  and 
the  technical  problems*  such  as  goals  of  production  and  distribution* 
System  problems  in  this  sense  are  socio«»technical  in  nature  rather  than 
either  nocial  and/or  technical  as  generally  treated  in  the  literature  and 
in  practice. 

The  Heuristic  Model  accounts  not  only  for  social  action*  but  also  for 
adaptation  and/or  resistance  to  change*  and  for  the  consequences  of  the 
responses  and  resulting  changes  occurring  within  and  between  an  organiza- 
tion*   The  first  consideration  of  interv^tion  is*  however*  the  action 
process*  which  is  composed  of  strategies  for  data  collection*  feedback  of 
observations  and  other  data*  and  planning  on  the  basis  of  feedback. 

The  stages  of  diagnosis  and  intervention  in  OD  strategies  cannot  be 
completely  separated.    Both  occur  simultaneously;  I.e.*  data  collection 
constitutes  an  intervention*  and  the  style  of  intervention  will  reveal  new 
data  derived  from  the  reaction  to  the  intervention.    The  action  process  in 
OD*  by  this  same  token*  cannot  be  rigidly  classified*  but  a  broad  classlfi** 
cation  can  be  suggested: 

1.  Data  collection:  (a)  perceived  existence  of  tension*  (b)  identic* 
fication  of  syiiqptoms*  (c)  enlarging  span  of  cognition;  and  (d)  delineation 
of  problem. 

2.  Feedback  of  observations  or  other  data~connunication  of  problem. 


ERIC 


-16- 

3«    Planning  on  the  basis  of  feedback:    (a)    establishing  desired 
objectives,  (b)  examination  of  alternative  processes,  (c) 
initiating  support  and  legitimation,  (d)  activating  change  pro- 
cess, and  (e)  critiquing  results « 

The  major  objectives  of  the  action  phases  of  the  Heuristic  Model  was 
to  present  at  a  conceptual  level  the  flow  of  social  action  from  the  per** 
ception  of  tension  in  a  client  system  to  its  final  completion  or  termlna-- 
tion«    Emphasis  was  on  conceptualizing  the  complex  action  process  in  a 
time  sequence «    If  the  model  and  its  phases  are  to  have  application  in  a 
real  organisational  sittiation,  the  phases  have  to  be  articulated  in  terms 
of  actions  to  be  taken  by  individuals  and  groups*    This  is  true  whether 
the  model  is  being  used  as  a  guide  to  action  by  the  change  agent,  as  an 
evaluative  instrtmient,  or  by  the  researcher  for  more  rigorous  analysis* 
One  suggested  approach  to  measurement  of  human  process  variables  at  each 
stage  of  the  action  process  would  be  to  assign  a  numerical  rating  at  each 
step  on  the  ability  of  organizational  members  to  utilize  the  heuristic 
process*    In  other  words,  the  extent  at  each  step  to  which  organizational 
members  practice: 

1*    Identification  of  organizational  mission  and  values* 

2*    Flexible  leadership* 

3*    Utilization  of  experlence-based  behavior* 

4*    Open  communications* 

5*    An  orientation  toward  collaboration* 

In  so  doing,  the  action  process  could  provide  yet  another  framework 
within  which  research  could  find  new  knowledge* 
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Siimmary  and  Implications 

The  schematic  Illustrated  In  Figure  2  suricnarlzes  the  total  OD  pro-- 
cess.    Here  the  two  discernible  dimensions  of  OD-^lagnosls  and  Interven- 
tlon-«are  brought  together  to  form  a  conceptual  conqposlte. 

The  diagnostic  or  analytic  phase  Is  represented  In  the  schematic 
by  the  center  circle  "Interfacing  situations"  and  the  five  surrounding 
strategic  variables  generated  from  the  research  design. 

The  Intervention  or  action  phase »  developed  from  the  diagnostic  phase » 
Is  represented  by  the  "centrifugal  rings"  of  tb^*  schematic  and  are  In- 
tended to  Illustrate  Is^plementatlon  of  the  action  process  with  subsequent 
change  and  consequences  of  change  being  considered. 

In  the  heuristic  approach  to  OD,  both  phases  are  necessary  for  iscan- 
Ingful  organizational  change. 


Flrgure  2:    Organization  development  process — a  Heuristic  Model 
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Professional  nurses  occupy  a  variety  of  positions  in  health  care 
institutions.    Over  one-half,  33% f  of  employed  nurses  (of  vhich  9B,&%  are 
vomen)  occupy  staff  nurse  positions.    By  role  prescription,  staff  nurses 
spend  the  greatest  proportion  of  their  time  in  direct  patient  care  activ- 
ities.   For  this  reason  and  also  because  they  constitute  the  single, 
largest  group  of  practicing  nurses,  it  is  important  to  knov  more  about  them, 
their  motivations  for  continuing  learning  and  their  educational  and  nursing 
activities.    This  kind  of  information  may  provide  insights  which  will  be  of 
assistance  in  the  iionediate  future  as  planning  intensifies  to  expand  con- 
tinuing education  opportunities  for  professional  nurses. 

V 

Purposes 

The  purposes  of  this  stucTy  were:    l)  to  identify  the  learning  orienta- 
tions and  patterns  of  nursing  and  continuing  education  activity  of  practi- 
cing staff  nurses,    2)  to  compare  two  groups  of  nurses  -  participants  and 
potential  participants  in  short-term  continuing  education  programs  -  in 
these  variables,  and  3)  to  identify  any  interrelationships  between  learning 
orientations,  nursing  and  continuing  education  activity  patterns  and  selected 
personal  characteristics. 

Definition  of  Terms 

For  the  purposes  of  this  research,  the  following  definitions  of  terms 
were  used: 

Practicing  staff  nurses  -  registered  professional  nurses  employed  in  staff 


niirse  positions  in  any  health  care  institution. 

Participants  -  nurses  who  have  participated  in  short-term  continuing  educa- 
tion programs  during  period  January  1,  1970  -  June  30,  1971* 
Potential  Participants  -  nurses  who  have  not  participated  in  short-term  con- 
tinuing education  programs  during  period  January  1,  1970  -  June  30,  1971$ 
hut  who  may  participate  in  these  kinds  of  programs  at  some  time  in  the  future. 
Short-term  continuing  education  programs  -  programs  varying  in  length  from 
one  to  five  weeks,  and  which  require  full-time  attendance. 
Learning  orientation  -  "the  major  principle  which  gives  meaning  or  direction 
to  the  continuing  learning  act  or  process  undertaken  hy  the  adult  learner."^ 
Pattern  -  the  set  of  item  variables  which  constitutes  a  common  factor. 
Continuing  education  activity  -  activity  engaged  in,  either  alone  or  in  a 
group,  "with  the  conscious  j.ntention  of  "bringing  ahout  changes  in  information, 
knowledge,  understanding,  skills,  appreciation  and  attitudes." 
Total  educational  activity  -  combined  leisure  time  and  Joh  time  continuing 
education  activities. 

Nursing  activity  -  "an  activity  in  ^ich  a  staff  nxirse  participates  for  the 
primary  purpose  of  promoting  the  welfare  of  the  patient,  the  nursing  unit, 
the  unit's  personnel,  or  the  hospital." 


Sherman  B.  Sheffield,  "The  Orientation  of  Adult  Continuing  Learners", 
in  The  Continuing  Learner,  ed.  hy  Daniel  Soloman  (Chicago:    Center  for  the 
Study  of  Liberal  Education  for  Adidts,  I96U),  p.  2. 

^A.  A.  Liverright,  A  Study  of  Adult  Education  in  the  United  States 
(Center  for  the  Study  of  Liberal  Education  for  Adults,  1968),  pp.  3-H. 

hiaxy  E.  Bevis,  "Report  to  the  Directors  of  Nursing  at  tiie  Five  Chicago 
Area  Hospitals  Cooperating  in  the  Testing  of  the  Job  Activity  Survey", 
Chicago,  1970,  p.  1.  (Mimeographed.) 


Relation  of  Previous  Research  to  the  I^potheses 


Continuing  education  Is  considered  essential  to  the  practice  of  pro- 
fessional nursing,  yet  very  little  Is  known  about  the  nurse  as  a  continual 
learner.    Other  than  Bennett,  no  one  has  Investigated  the  learning  orienta- 
tions of  nurses.    Flaherty  sought  to  determine  what  motivates  nurses  to  par- 
ticipate In  learning  activities.    It  Is  important  that  this  beginning  be 
continued.    It  may  be  that  nurses  have  different  learning  orientation  pat- 
terns than  those  Initially  identified  by  Houle,  Sheffield,  Boshler  and 
Burgess. 

In  the  studies  reviewed,  a  consistent  finding  was  that  different  popu- 
lations participate  In  continuing  education  activities  In  varying  degrees. 
In  addition,  Johnstone  and  Rlvex^  iientlfled  regional  differences  in  educa- 
tional participation.    Bevls'  study  was  the  first  in  nursing  which  con- 
sidered the  tot€Ll  educational  activity  of  nurses.    Since  her  sample  was 
limited  to  graduates  of  baccalaureate  nursing  programs,  it  was  considered 
important  to  investigate  the  extent  and  nature  of  continuing  education  in  a 
wider,  more  representative  sample  of  the  n\irse  poptilatlon,  including  grad- 
uates of  all  three  types  of  nursing  programs  -  associate  degree,  diploma  and 
baccalaureate.    Also,  Bevls*  study  was  centered  in  the  midwest.    This  study 
is  focused  on  a  different  region  of  the  coiintry,  the  Central  New  York  area. 

Since  no  prior  research  was  fo\md  in  the  area  of  nursing  activity  pat- 
terns, it  was  considered  important  to  attempt  to  identify  these.    Once  pat- 
terns of  nursing  activity,  as  well  as  patterns  of  leisure  time  and  Job  time 
continuing  education  activity  have  been  identified,  different  kinds  of 
relationships  can  be  studied. 


The  I^potheses 


Pfiurticipation  in  short-term  continuing  education  programs  was  the 
independent  variahle  in  this  studi^    The  suhjects  were  divided  into  two 
groups:    participants  -  those  vho  had  participated  in  short-term  con- 
tinuing education  programs  in  nursing  diiring  the  period  January  1970  to 
June  1971;  and  potential  particippiits  -  those  who  had  not  participated 
in  these  kinds  of  programs  during  this  time  period. 

Seven  hypotheses  were  tested. 

1.  There  are  differences  in  learning  orientations »  as  measxired  hy 
Sheffield's  ''Continuing  Learning  Orientation  Index",  hetween  the  partici- 
pant and  potential  participant  groups. 

2.  There  are  differences  in  the  continuing  education  activity  pat- 
terns of  staff  nurses  during  thoir  leisure  time»  as  measured  Ify  Litchfield  *s 
"Leisure  Activity  Survey",  hetveen  the  participant  and  potential  participant 
groups. 

3.  There  are  differences  in  the  Joh  time  continuing  education  activity 
patterns  of  staff  nurses,  as  measured  hy  Bevis*  "Job  Activity  Survey", 
between  the  participant  and  potential  participant  groups. 

h.    There  is  a  difference  in  eactent  of  total  educational  activity,  as 
measured  by  the  cubined  scores  on  Litchfield's  "Leisure  Activity  Survey" 
and  Bevis*  "Job  Activity  Survey",  between  the  participant  and  potential  par- 
ticipant groups. 

5.  There  are  differences  in  the  nursing  activity  patterns  of  staff 
nurses,  as  measured  by  Bevis*  "Job  Activity  Survey",  between  the  participant 
and  potential  participant  groups. 

6.  There  is  a  relationship  between  extent  of  total  educational  activity 
and  nursing  activity  patterns  in  the  participant  and  potential  participant 


groups. 

7*    There  are  interrelationships  among  demographic  data»  learning 
orientations,  total  educational  activity  and  patterns  of  nursing  activity. 

Sample  Selection 

Since  nursing  is  primarily  a  female  profession,  the  sample  selected 
for  the  study  was  limited  to  female  practicing  staff  nurses.    The  sample 
was  selected  from  two  groups  of  nurses  vlthln  the  Central  New  York  Area. 
Nurses  who  had  participated  in  8kQrt-»term  continuing  education  programs 
comprised  the  participant  group.    Nurses  who  had  not  participated  in  these 
programs  and  who  worked  in  the  same  health  agencies  as  the  participant 
group  comprised  the  potential  participant  group.    The  only  knovn  difference 
between  the  two  groups  of  nurses  was  their  ^'participation**  status. 

The  Survey  Instrument 

The  c^plete  survey  instrument  consisted  of  four  parts: 

Part  I:     Job  Activity  Survey  -  110  items 

Part  II:    Leisxare  Activity  Survey  •  k6  scorable  items 

Part  III:  Motivation  Survey  -  58  items 

Part  IV:    Personal  Data  Questionnaire 

Part  I.    Job  Activity  Survey 

Bevis*  "Job  Activity  Sxirvey",  the  "JAS",  was  used  to  measure  Job  time 
educational  activity  as  well  as  nursing  activity.^  This  investigator  used 
the  instrument  exactly  as  designed  by  Bevis. 

The  "Job  Activity  Survey"  consists  of  110  items.  Forty-seven  of  these 
items  measure  on-the-job  educational  activity  and  sixty^i-three  items  measure 
nursing  activity.    The  total  instnament  was  subjected  by  Bevis  to  procedures 

^Mary  E.  Bevis,  "Role  Conception  and  the  Continuing  Learning  Activities 
of  Neuphyte  Collegiate  Nurses"  (unpublished  Ph.D.  dissertation,  University 
of  Chicago,  1971). 
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which  measured  face,  content  and  construct  validity. 

The  instrvunent  was  also  pretested  at  five  Chicago-area  hospiteils 
with  a  stratified  random  sample  of  seventy-five  registered  nurses.  Bevis 
subjected  the  pre-test  responses  to  item  analysis  and  concluded: 

Although  the  instrument  had  heen  designed  to  measure 
educational  participation,  the  item  anetlysis  indicated 
that  the  instnament  shoved  promise  as  a  tool  for  evalu- 
ating the  quality  of  nursing  practice  and  the  a^ity 
of  on-the-Jot  learning  experiences. ^ 

Bevis'  suggestion  for  an  additional  use  of  the  "JAS"  instrument  was 

accepted  by  this  investigator.    The  responses  to  the  educationcuL  activity 

items  were  used  to  measure  educational  participation.    In  addition,  the 

responses  to  the  nursing  activity  items  were  used  to  identify  patterns  of 

nursing  activity. 

Bevis  did  reliability  testing  of  the  instrument  on  data  gathered  in 
the  pre-test.    The  split-half  reliability  determined  from  the  responses 
of  the  68  subjects  to  the  110  items  of  the  instrument  was  .96  (corrected 
for  attenuation).    The  test-retest  reliability  using  twenty-two  subjects 
was  .88.2 

The  weighting  of  the  forty-seven  educational  items  was  done  by  Bevis 
with  a  panel  of  eight  nursing  educators  and  eight  nursing  service  adminis- 
trators and  nursing  practitioners.    Their  Judgment  of  degree  of  educative- 
ness  was  the  basis  of  the  weights*  assignment  which  ranged  from  a  low  of 
one  to  a  high  of  four.^ 

''"Bevis,  "Report  to  the  Directors  of  Nursing  at  the  Five  Chicago-Area 
Hospitals  Cooperating  in  the  Testing  of  the  Job  Activity  Survey,  p.  3. 

^rbid.,  p.  8. 

^Ibid.,  p.  2. 
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The  score  for  extent  of  educational  pairbicipation  on  the  Job  is 
calcxilated  using  the  assigned  weight  and  tiie  number  assigned  to  the 
designated  time  interval,  zero  to  five.    The  range  of  possible  scores 
is  0  to  650. 

Part  II !    The  Leisure  Activity  Survey 

Litchfield* s  "Leisxare  Activity  Survey",  the  "LAS",  was  used  to 
measure  leisure  tine  participation  in  continuing  education  activities. 
The  "LAS"  vas  used  exactly  as  developed  by  Litchfield  with  the  following 
minor  changes,  which  were  initially  made  by  Bevis  with  Litchfield's 
approval : 

1.  In  the  statement  of  purpose,  the  word  "people"  was  changed 
to  "nurses. 

2.  The  wording  of  selected  inteirval  headings  on  the  zero  to 
five  scale  was  slightly  changed  in  order  to  match  the  format  of  the 
other  instznments  used. 

Litchfield's  "Leisure  Activity  Survey"  ("LAS")  uses    a  quantifiable 
six  point  scale.    The  "LAS"  contains  ninety-nine  items,  only  forty-six 
of  which  are  scored  as  educational.    The  intent  of  the  instrument  is 
purposefully  masked  to  eliminate  possible  respondent  bias  about  education. 
The  fifty-three  non-scored  general,  non-educational  leisure  activity 
items  included  allow  all  persons  completing  the  instrument  an  opportunity 
to  indicate  participation.^ 

Litchfield  tested  the  "LAS"  by  means  of  content  and  concurrent  vali- 
dation procedures. 

■""Ann  Litchfield,  "The  Nature  and  Pattern  of  Participation  in  Adult 
Education  Activitiei^' (unpublished  Ph.D.  dissertation,  University  of 
Chicago,  1965),  pp.  25-26. 
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Litchfield  used  a  test-retest  procedure  to  measure  the  "LAS's" 
reliability.    She  administered  the  "LAS"  twice  to  twenty-three  subjects • 
The  interval  between  test  administrations  was  two  and  one-hcdf  weeks. 
Only  the  forty-six  educational  items  were  scored.    The  product-moment 
correlation  obtained  was  .77*    She  also  used  the  Kuder-Ric hard son  Form- 
ula 20  for  calculating  the  reliability  of  the  responses  of  her  total 
saoqple  of  11^9  subjects.    The  correlation  obtained  from  these  data  was 
.88.1 

Litchfield's  method  for  measurement  of  extent  of  educational  parti- 
cipation was  used  in  this  study. 

An  individual's  extent  of  participation  score  was 
determined  by  multiplying  each  of  the  forty-six 
educational  activities  in  which  the  respondent  took 
part  (possibilities  are  0  to  k6)^  by  the  weight 
assigned  to  that  item  indicating  degree  of  educative- 
ness  (possibilities  are  k  high  to  1  low) ,  and  by 
multiplying  that  figure  by  the  weight  assigned  to  the 
time  interval  circled  }yy  the  respondent  on  the  scale 
for  each  group  of  activities  (possibilities  are  zero 
for  no  participation  to  five  for  greatest  participa- 
tion. ^ 

The  rorty-six  individual  item  scores  are  summed  for  the  individxxal '  s 
total  score  on  "LAS".    The  maximum  possible  score  is  6l^«    The  lowest 
total  score  possible  is  zero. 

Part  III;    Motivation  Survey  ("Learning  Orientation  Index") 

Sheffield's  "Continuing  Learning  Orientation  Index"  was  used  to 
identify  leasming  orientations.    The  instrument  was  used  exactly  as 
developed  by  Sheffield  with  the  following  minor  changes. 

^Ibid. >  pp.  50-51. 
^Ibid. .  p.  38. 
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1.  The  title  of  the  instrument  vas  changed  to  Motivation  Survey. 
This  vas  done  to  achieve  consistency  with  the  titles  of  the  other  instru- 
ments used  as  veil  as  to  eliminate  a  focus  on  learning  orientation. 

2.  An  explanation  of  purpose  vas  added  imedlately  prior  to  the 
directions.  It  read:  "The  purpose  of  this  survey  is  to  identify  the 
factors  motivating  nurses  to  participate  in  educational  activities." 

3.  The  format  of  the  directions  vao  changed  to  he  consistent  vith 
those  for  con^leting  the  other  instnments. 

The  "Learning  Orientation  Index",  as  constructed  by  Sheffield,  con- 
tains fifty-eight  items  which  can  be  scored  according  to  a  five  point 
Loale.    The  items  were  validated  primarily  on  content  validity  by  a  panel 
of  ten  adult  educators. 

Sheffield  estimated  the  coefficient  of  equivalence  reliability  for 
the  "Learning  Orientation  Index"  by  using  the  split-half  method.  The 
reliability  for  the  fifty-eight  items  administered  to  his  sample  of  1*53 
adxilts  vas  .9^.^ 

Part  IV:    Personal  Data  Questionnaire 

The  personal  data  questionnaire  vas  designed  by  this  investigator. 

Data  Collection 

Each  subject  was  given  a  six  digit  code  number  to  guarantee  anony- 
mity.   The  first  two  digits  designated  the  agency,  the  next  three  the 
individual  subject  and  the  sixth  the  group  and  particvdar  short-term  con- 
tinuing education  program(s)  attended. 

^Sheffield,  The  Orientation's  of  M\ilt  Continuing  Leai'ners,  p.  29. 
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The  survey  instrument,  introduced  by  a  cover  letter,  was  mailed,  along 
with  a  stamped  addressed  return  envelope  to  the  home  address  of  each  sub- 
Ject. 

The  mailing  took  place  during  the  period  September  27  -  October  15,  1971. 
This  first  mailing  resulted  in  a  return  of  17l»  questionnaires.    One  follow- 
up  mailing  to  those  who  had  not  yet  responded  took  place  during  the  period 
October  21-26,  1971.    The  date  of  November  16,  1971,  marked  the  close  of  the 
period  for  collection  of  data. 

Ljipltations 

1.  The  sample  was  selected  from  female  registered  ^professional  staff 
nurses  employed  in  the  Central  New  York  Region.    Therefore,  efforts  at  gen- 
eralizing nationwide  must  be  do.ncs  with  extreme  caution. 

2.  The  sample  represented  tcaff  nurses  employed  in  general  hospitals, 
nursing  homes,  extended  care  facilities  and  public  health  agencies.    It  did 
not  include  representation  from  psychiatric  or  other  specialized  hospitals 
or  institutions,  industrial  nurses,  school  nurses  or  private  duty  nurses. 

3.  Group  II  of  the  sample  was  self-selected.    These  subjects  volun- 
tarily attended  short-term  continuing  education  programs.    Their  enrollment 
in  these  programs  was  the  basis  for  their  selection. 

1*.    The  time  period  during  which  Group  XI  subjects  participated  in  short- 
term  continuing  education  programs  was  Jar.uftr/  1970  through  June  1  71.  The 
data  were  collected  during  the  period  Sepweniber  27  -  November  I6,  1971.  His- 
tory and  maturation  were  possible  sources  of  invalidity  over  thi»  perio;. 

5.    Questionnaires  were  self-administered.    Personal  c^iaracterl etics  of 
some  subjects  may  have  interfered  with  .     xate  completion  of  the  question- 
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naire  which  required  self-evalxiation  oy  the  respondents.    Some  indivi- 
duals have  a  tendency  to  underestimate  their  abilities  and  activities 
and  others  overestimate  these.    It  is  assumed  that  the  errors  will  be 
randomly  distributed  over  the  items  and  not  influence  the  resTilts. 

6.  Measurement  error  must  be  assimied  as  present  in  each  of  the 
instrments. 

7.  Judgments  were  made  on  the  basis  of  a  return  of  78.2  per  cent. 
There  was  no  way  to  allow  for  the  21.8  per  cent  \rbo  did  not  respond. 

The  Data  Analysis  Plan 

An  index  card  for  each  member  of  bhe  selected  sample  was  made.  This 
card  contained  name,  position,  agency,  the  particular  short-term  continuing 
education  program  attended,  if  any,  with  its  inclusive  dates,  and  an 
assigned  identification  number. 

The  identification  number  was  written  in  the  designated  place  on  the 
last  page  of  each  sxirvey  instrument.    The  coded  instruments  were  mailed  to 
the  home  address  of  each  member  of  the  sample.    As  the  completed  question- 
naires were  returned,  the  appropriate  notation  was  made  on  each  index  card. 

Two  hundred  and  thirty-seven  completed  questionnaires  were  returned 
and  all  were  used  in  the  data  analysis.    The  data  ft'cm  each  were  transposed 
to  an  IBM  coding  form  for  key-punching.    A  blank  was  left  to  represent  any 
inconqpleted  item.    Conqputer  cards  were  keypunched,  verified  and  the  data 
analyzed  using  the  IBM  370-155  computer.    The  potential  participants,  llU 
subjects,  composed  Group  I  and  the  pajrticipants,  123  subjects,  composed 
Group  II. 

Frequency  counts  were  done  for  each  item  in  the  personal  data  question- 
naire and  the  associated  percentages  were  calculated. 
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The  statistical  characteristics  -  distribution,  range,  mean,  and 
standard  deviation  were  computed  for  the  "LAS"  and  "JAS"  educational 
items,  as  well  as  for  the  extent  of  total  peurticipation  in  continuing 
education  activities  ("LAS"  plus  "JAS"  educationia  scores).    To  determine 
significant  differences  between  the  two  groups  in  these  variables,  t-tests 
were  done.''' 

The  data  from  the  fifty-eight  item  "Learning  Orientation  Index",  the 
forty-six  educational  activity  items  of  the  "Leisure  Activity  Survey", 
the  forty-seven  educationeil  items  and  the  sixty-three  nursing  activity 

items  from  the  "JoD  Activity  Survey"  were  each  subjected  to  the  principal 

p 

coBiponents  analysis  with  vcurimax  rotation.     A  t-test  was  done  on  mean 
differences  of  factor  scores  for  each  extracted  factor  to  determine 
significant  differences  between  the  potential  participant  and  participant 
groups  in  these  patterns. 

Peeurson  product-moment  coefficients  of  correlation  were  computed 
between  the  factor  scores  of  the  "Leeuming  Orientation  Index",  the 
"JAS"  nursing  activity  patterns,  the  total  extent  of  educational  activity 
and  seven  personal  characteristics:    age,  number  of  children  -  total, 
pre-school  age,  elementary  school  age,  secondary  school  age;  nursing 
preparation;  and  education  beyond  the  basic  program. 

^Descriptive  statistics  were  derived  using  the  Tsar  statistical 
package  for  the  IBM  370-155  computer  which  is  available  at  the  Syracuse 
University  Computing  Center. 

2 

The  program  used  was  "The  Principal  Componiiuts  Analysis  with  Varimax 
Rotation"  with  subroutines  written  or  adapted  by  Paul  R.  Lohnes,  State 
University  of  New  York  at  Buffalo,  Rolf  H.  Monge,  Silas  Halperin  and 
Peter  Prowda  at  Syracuse  University.    The  principal  components  analyses 
were  done  using  a  missing  data  correlation  matrix.    Therefore,  factor 
scores  will  approach  a  mecm  of  zero  and  a  standard  deviation  of  one  and 
intercorrelations  will  approach  zero.    This  effects  mainly  the  factor 
analysis  of  the  "Learning  Orientation  Index"  since  two  subjects,  both 
members  of  the  potential  participant  group,  left  this  instrument  blank. 
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Description  of  the  Respondents 

Two  hundred  and  thirty-seven  nurses  representing  30  general  hospitals, 
5  public  health  agencies  and  7  nursing  homes  and/or  extended  care  facilities 
completed  and  returned  the  survey  instrument.    This  constituted  a  78.2 
per  cent  return  rate.    The  potential  participeuats ,  who  composed  Group  I, 
returned  111*  completed  instruments  -  a  return  rate  of  78.6  per  cent. 
The  participants,  who  composed  Group  II,  returned  123  completed  instru- 
ments -  a  return  rate  of  77*8  per  cent. 

The  characteristics  of  the  total  sample  cem  be  summarized  as  fol- 
lows:   the  nurses  were  primarily  young  -  thirty  years  of  age  or  less, 
married  and  slightly  less  than  half  were  mothers  of  children  of  pre- 
school and  elementary  school  age.    They  were  predominantly  graduates 
of  associate  degree  and  diploma  programs  with  the  greatest  number  having 
had  their  basic  preparation  in  diploma  programs.    Slightly  less  than 
half,  1*8  per  cent,  had  some  credit  education  beyond  the  basic  program. 
There  were  no  nurses  with  either  master's  or  doctoral  degrees.  Less 
than  a  third,  29  per  cent,  indicated  membership  in  any  professional 
associations.    The  largest  number  were  eii5)loyed^;L^,,medical-surgical 
areas  with  an  experience  range  of  one  to  twenty  or  more  years  with 
the  majority  having  ten  years  or  less  of  experience. 

The  participant  and  potential  participant  groups  did  not  vary 
significantly  from  each  other  in  the  variables  -of  marital  status,  total 
number  of  children,  number  of  children  of  pre-school  or  elementary 
school  age,  nursing    preparation,  education  beyond  the  basic  program  or 
professional  affiliations.    However,  there  were  significant  differences 
between  the  two  groups  in  the  variables  of  age,  number  of  children  of 


secondary  school  age,  clinical  specialties  and  years  of  nursing  experience. 
The  respondents  in  the  potential  participant  group,  compared  to  the  par- 
ticipant group,  were  younger,  had  fewer  secondary  school  age  children, 
represented  more  clinical  specialties,  were  less  involved  with  specialty 
units  (e.g.,  respiratory,  coronary  care),  and  were  likely  to  he  included 
in  the  extremes  in  years  of  nursing  experience  (one  year  or  less  and 
twenty  years  or  more).    The  differences  between  the  two  groups  in  these 
variables  warrants  consideration  as  the  other  results  are  presented. 

Steps  Followed  in  Testing  Hypotheses 

All  data  were  analyzed  using  the  IBM  370-155  Computer.  An  alpha 
V€JLue  of  .05  vas  established  as  the  acceptable  significance  level  for 
t>^e  statistical  tests  used. 

Step  1.    Principal  Components  Analysis  with  Varimax  Rotation 

A  principal  components  ancOLysis  with  varimax  rotation  was  performed 
on  the  data  from  each  of  the  three  instruments  used  -  the  ''Learning 
Orientation  Index",  the  "Leisure  Activity  Survey"  and  the  "Job  Activity 
Survey". The  principal  components  analysis  was  done  as  the  initial  step 
in  testing  hypothesis  1,  2^  3  and  p.    This  analysis  enabled  identification 
of  the  learning  orientation  patterns,  the  leisure  time  and  Job  time 
continuing  education  patterns,  and  the  nursing  activity  patterns.  This 
proced\ire  of  principal  components  analysis  with  varimax  rotation  resulted 
in  reducing  the  data  to  a  simple  structure  and  the  extraction  of  the 
principal  factors  from  the  item  variables  of  each  instnmient.  Harman 
states  that  this  is  the  fundamentcOL  purpose  of  factor  analysis  -  "to 
comprehend  a  large  class  of  phenomena  (the  values  of  a  set  of  variables) 

■""The  program  used  was  "The  Principal  Components  Analysis  with  Varimax 
Rotation"  with  subroutines  written  or  adapted  by  Paul  R.  Lohnes,  State 
University  of  New  York  at  Buffalo,  Rolf  H.  Monge,  Silar  Halperin  and 
Q  Peter  Prowda  b,V  Syracuse  University. 
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in  terms  of  a  small  numter  of  concepts  (the  factors)."^   The  varimax 
solution  also  has  the  property  of  Invaxlance.    Harman  explains  that  this 
means  **that  vcurinax  factors  obtained  In  a  sample  will  have  a  greater 
likelihood  of  portraying  the  xinlverse  vcurimax  factors"  • 

Step  2.    Identifying  and  Defining  the  Patteras 

The  following  criteria  were  used  In  ancdyzlng  the  factor  structures 
and  defining  the  patterns; 

1.  '   An  Item  vas  to  have  a  factor  loading  (coefficient)  of  at  least 
.kO  to  he  Included  In  a  common  factor.    This  1. ending  vas  selected  In  order 
to  facilitate  a  comparison  of  extracted  patterns  with  those  fotand  in  the 
original  studies  which  used  this  seme  criterion. 

2.  Factors  which  ccatained  at  ],east  two  items  with  loadings  of  .kO 
or  more  and  which  accounted  for  2  per  cent  or  more  of  the  variance  were 
defined  and  retained  in  the  fined  solution.    Such  factors  were  considered 
to  have  practical  significance.  .  . 

3.  The  factor  name  was  derived  from  the  nature  of  the  variables 
having  the  highest  correlations  with  the  factor  and  is  representative 

of  all  variables  within  the  factor,  Including  those  which  had  low 

3 

correlations. 

Step  3.    Identifying  Differences  in  Patterns  Between  Participand  and 
Potential  Participant  Groups 

Factor  scores  in  each  pattern  were  computed  using  the  Kaiser  Varimax 
k 

Method.  Means  of  factor  scores  for  each  group,  peurticipants  and  po- 
tential participants,  were  coxnputed  and  differences  between  the  means 


''"Harman,  Modern  Factor  Analysis,  p.  lUl. 

^Ibid.,  pp.  307-308 
3 

Ibid.,  p.  Ikl. 

k 

.  Henry  P.  Kaiser,  "Formula  for  Component  Scores",  Psychometrika 
(Vol.'  27 >  No>  1^  March  1962),  pp.  83->86> 
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were  determined  by  t-tests. 

It  is  important  to  note  the  signs  of  the  factor  loadings  in  each 
pattern.    Negative  loadings  are  a  function  of  the  numerical  etnalysis, 
except  in  bipolar  factors.    Thus,  the  "lowest"  mean  factor  score  in  a 
factor  composed  of  activity  item  variables  with  negative  factor  loadings 
represents  the  "highest"  degree  of  participation  in  that  factor. 

Step  U>    Computing  Educational  Scores  and  Testing  for  Differences  Between 


The  methods  specified  in  the  section  of  Chapter  III  titled  "The 
Surv^  Instrument"  were  used  to  compute  leisure  time  and  Job  time  education 
scores*    These  scores  were  then  summed  to  get  a  total  educational  score. 
Differences  in  extent  of  participation  in  educational  activities  between 
the  participant  and  potential  ^   'ticipant  groups  were  determined  by  t-tests. 
The  procedures  were  used  in  testing  the  fourth  hypothesis. 

Step^  5>    Determining  Interrelationships  Between  Selected  Variables 

Pearson  product-moment  coefficients  of  correlation  were  calculated 
to  measure  interrelationships.  This  procedure  was  used  specifically  in 
the  testing  of  the  sixth  and  seventh  hypotheses* 


The  Kuder-Richardson  Formula  20  was  used  to  compute  the  reliability 
coefficients  from  the  data  collected  on  each  of  the  instruments  used  in 
this  study*    The  results  were  as  follows: 


Groups 


Reliability  of  the  Instruments 


ft 


Learning  Orientation  Index" 
Leisure  Activity  Survey" 
'Job  Activity  Survey:" 


r  =  .96 
r  =  .8k 


ft 


ft 


nursing  activity  items 


educational  items 


r  =  .87 
r  «  .95 
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The  Reaults 


Seven  hypotheses  were  tested  and  in  each  Instance  the  alter-^ 

native  hypothesis  was  accepted. 

Hypothesis  I:    Eight  patterns  of  learning  orientation  were  identified. 

I.    Learning  Orientation 

II.    Goal  Orientation 
1 .  PersoneLL-Goal 
2  •    Oceupat  ional-*Goal 
3 .    Prof  essional-*6oal 
h.  Societal-Gtoal 

III.    Activity  Orientation 

1 .  Need-Fiilf  illment 

2 .  Personal-Sociability 

3 .  Prof es  sional-Soc  iahil ity 

The  participant  group  scored  significantly  higher  than  the  potential 
participant  group  in  both  the  learning  and  the  personal^goal  orientation 
patterns . 


I^othesis  II:  Twelve  leisure  time  continuing  education  activity  pat- 
terns were  identified  and  arranged  in  the  following  typology: 

I.    GenercLL  and  Specialized  IQaowledge  Seeking 
.  1.    Literaxy /General  Cognitive 

2.  Literary/Special  Interest 

3.  Mass  Media/Current  Affairs 
k.    Specific  Information/Hobby 

II.  Religious  Activity 

III.  Home/Family/Conmunity  Interests 

IV.  Participation  in  Special  Interest  Activities 

V.  Classical  Music /Performing  Arts 

VI.  Humanistic  Concerns 

VII •    Organized  Learning 

1.  Group  Learning 

2.  Course  Taking 

3.  Audio-Visual  Assisted  Learning 
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The  participant  group  scored  significantly  higher  than  the  potential 
participant  group  in  two  leisure  tine  continuing  education  activity 
patterns:    Group  Learning  and  Course  Taking. 


Hypothesis  III:    Twelve  Job  tine  continuing  education  activity  patterns 
were  identified  and  arranged  in  the  following  typology: 

I.    Clinical  Infoznation 

1.  Clinical  Knowledge  Seeking 

2,  Reference  Consulting 

II.    Organized  Group  Learning 

1.  Group  Learning  -  Participation/Preparation 

2.  Inservice  Education 

•» 

III.    Professional  Growth  and  Develop©.cnt 

1.  Professional  Activities 

2.  Professional  Nuirslng  Practice  -  Decision  Making 

3.  Personal  Professional  Development 

h.    Group  Participation  •  Hospital/Agency  Related 

5.  Organizational  Activities  •  Profession  Related 

6.  Information  Seeking  -  Multi-Media 

IV.  Patient-Centered 

1.  Patient-Centered  Information  Seeking 

2.  Planning  Nursing  Care 

The  participant  group  scored  significantly  higher  than  the  potential 
participant  group  in  four  Job  tine  continuing  education  activity  patterns 
Clinical  Knowledge  Seeking;  Planning  Nursing  Care;  Group  Learning  - 
Participation/Preparation;  and  Professional  Nursing  Practice  -  Decision 
Making. 


Hypothesis  IV:    The  participant  group  differed  significantly  from  the 
potential  participant  group  in  extent  of  total  educational  activity.  The 
participant  group  had  significantly  hig.  .x*  scores  in  both  Job  time  and 
leisui-'e  time  continuing  education  activities. 
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Hypothesis  V:  Ten  nursing  activity  patterns  were  identified  and  arranged 
in  a  typology  taken  from  the  newly  enacted  definition  of  professional 


I*    Through  Such  Services  as  Casefinding,  Health  Teaching,  Health 
Counseling. • • 

1,  Teaching/Coordinating  Patient  Care  and  Niarsing  Activities 

2.  Counseling  Patients,  Faxaily,  Staff /Planning  Patient  Care 
3«    Teaching  Other  Health  Personnel 

II.    Provision  of  Care  Supportive  to  or  Restorative  of  Life  and  Well- 
Being  and  Executing  Medical  Regimens. 

1.  Life-Sustaining  Nursing  Measures  -  Physical/Spiritual 

2.  Meeting  Physical  Needs  of  Patients  Through  Nursing  and  Medical 
Regimens 

3.  Treatments     Nxir sing/Physician  Ordered 
Medications,  Vital  Signs  and  Recordings 

5*  Nursing-Related 

6.  Ntirsin^  Directed  or  Assisted 

7.  Concern  for  Groups  of  Patients 

Significant  differences  were  foimd  between  the  participant  and 
potential  participant  groups  in  three  nursing  activity  patterns.  The 
participant  group  engaged  more  frequently  than  th<a  potential  participant 
group  in  the  nursing  activity  patterns:    Teaching/Coordinating  Patient  Care 
and  Nursing  Activities;  Counseling  Patients,  Family,  Staff /Planning  Patient 
Care;  and  Life  Sustaining  Nursing  Measures  »  Physical/Spiritual. 


Hypothesis  VI:    Significant  positive  relationships  were  found  between 
seven  different  nursing  activity  patterns  and  the  extent  of  total 
educational  activity.    These  relationships  differed  in  degree  between 
the  participant  and  potential  participant  groups. 


Hypothesis  VII:    Significant  interrelationships  were  found  between 
selected  demographic  variables,  lecuming  orientations,  total  educational 
activity  and  patterns  of  nursing  activity. 


nursing  in  New  York  State. 
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Conclusions 

!•    Learning  orientations  were  of  three  major  types  -  learning,  goal 
and  activity.    The  goal  orientation  divided  into  the  sub-types  of  personal- 
goal;  occupational-goal;  professional-goal  and  societal-goal.    The  activity 
orientation  divided  into  two  major  types  -  sociability  and  need-fulfillment. 
The  sociability  orientation  consisted  of  two  sub-types;    per sonal-soc lability 
and  professional-sociability. 

2.  Continuing  learners  differed  in  the  extent  to  tAich  they  held 
various  learning  orientations.    The  stability  of  the  orientations  is  yet  to 
be  determined^ 

3.  Nurses  who  had  participated  in  short-term  continuing  education 
programs  had  significantly  higher  scores  in  both  the  learning  orientation  and 
the  personal-goal  orientation  than  did  the  potential  participants. 

k.    All  nurses  participated  to  some  extent  in  continuing  learning  ^ 
activities,  both  during  their  leisure  and  Job  time* 

5*  Nurses  who  had  participated  In  short-*term  continuing  education  pro- 
grams differed  significantly  frc»  potential  participants  in  selected  patterns 
of  continuing  education  activity. 

6.    Nurses  who  had  participated  in  short-term  continuing  education  pro- 
grams appeared  to  have  a  different  life  style  -^hich  included  more  time  for  a 
wide  variety  of  learning  experiences.    This  was  apparent  in  both  their  leisure 
and  Job  time  continuing  education  activities.    These  nurses  may  be  described 
as  active  learners  who  employed  a  variety  of  methods  in  their  continuing 
learning  activities. 

?•    There  were  positive  relationships  between  extent  of  total  educational 
activity  and  seven  of  the  ten  nursing  activity  pattenis.    Continuing  education 
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appeared  to  be  a  significant  factor  in  relationship  to  the  degree  nurses 
participated  in  selected  nursing  activitiea. 

6.    Extent  of  past  continuing  learning  activity  appeared  to  he  as 
important  a  vcuriahle  as  level  of  formal  education  for  predicting  the  extent 
of  totaJ.  educational  activity. 

9*    Nurses  who  had  attended  shorts-term  continuing  education  programs 
participated  more  extensively  in  the  nursing  activities  comprising  the 
patterns:    Teaching/Coordinating  Patient  Care  and  Nursing  Activities;  and 
Counseling  Patients,  Family,  Staff /Planning  Patient  Care.    There  was  also 
a  positive  relationship  between  both  of  these  nursing  activity  patterns  and 
extent  of  total  educational  activity.    The  findings  suggest  that  when  a 
nurse  is  secure  in  her  knowledge  she  is  more  likely  to  engage  in  these  kinds 
of  nursing  activities. 

10.  The  type  of  basic  ntirslng  program  attended  by  nurses  may  have  an 
influence  on  their  learning  orientations,  and  their  participation  in  con- 
tinuing education  activities.    This  possibility  awaits  further  research  for 
clarification  or  rejection. 

11.  Leaorning  orientations  appeared  to  be  related  to  both  age  of  the 
nurses  and  the  number  of  children  they  bad. 

12.  A  low  negative  relationship  existed  between  total  nxmiber  of 
children  that  the  nurses  had  and  their  extent  of  total  educational  activity. 

13*    There  were  significant  interrelationships  between  the  learning, 
personal-sociability,  occupational-goal,  societal-goal  and  personal-goal 
orientations  and  toted  educational  activity. 

lU.    The  variable,  basic  nxirsing  preparation,  was  related  to  selected 
nursing  activity  patterns.    The  significance  of  these  relationships  awaits 
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further  research. 

15 •    The  personal  characteristics  of  age»  total  number  of  children 
and  children  of  elementary  and  secondary  school  age  vere  negatively  related 
to  selected  nursing  activity  patterns. 


opinion  Leadership  in  Family  Living  Among  Lovt  Income 
Homemakars  in  the  Expanded  Nutrition  Program  in  Ohio* 

by:    Doris  H.  Steele,  Ph.D.,  Supervisor  and 

Program  Leader  in  Home  Economics,  Vermont 
Extension  Service 

Welcome  from  across  the  borderl    Specifically,  greetings 
irom  Vermont.    It  is  indeed  a  pleasure  to  attend  your 
conference  and  to  become  more  aware  of  the  progress  being 
made  in  the  adult  education  field  which,  incidentally, 
is  making  groat  strides. 

I  truly  feel  when  man  finishes  his  formal  education 
he  should  consider  his  quest  for  knovrledge  is  just  beginning 
and  must  continue.    One  might  say  search  for  education 
continues  from  the  cradle  ro  the  grave.    Through  education, 
man's  personality  is  enriched  by  widening  his  intellectual 
horizon.    Education  gives  man  the  knowledge  to  understand 
his  observations  and  what  lies  beyond  his  personal  experiences. 

Why  study  research?    The  purpose,  as  it  relates  to 
your  area  of  conct  -n,  I  believa  is  to  improve  adult  education. 
And  so,  it  is  indeed  a  pleasure  to  share  tha  research 
process  as  it  relates  to  my  specific  study,  "Opinion 
Leadership  in  Family  Living  Among  Low  Income  Homemakers 
in  the  Expanded  Nutrition  Program  in  Ohio." 

Need  for  Study 

The  cooperative  Extension  Service,  along  ^d.th  other 
agencies,  has  directed  a  considerable  portion  of  its 
resources  to  work  with  low  income  families.    The  most  current 
emphasis  of  the  Extension  Service  is  the  expanded  Food  and 
Nutrition  Program  with  low  income  families  in  the  50  states 
and  Puerto  Rico. 

As  Extension  assumed  the  leadership  of  working  with 
low  income  families  in  family  living,  it  needed  to  develop 
new  techniques'  and  methods.    One  that  had  not  been  developed 
to  any  extent  was  working  through  the  leaders  among  the  low 
income  homemakers.    T-^  ccnaco-ve  resources— time,  money  and 
energy^-and  reach  a  larger  number  of  clientele  more  adequately, 
it  seemed  necessary  to  i.de-.i-..i.fy  those  opinion  leaders 
from  whom  low  income  homeirAl'ers  sought  advice  and  information 
in  tamily  living. 


♦Presentation  given  at  the  Adult  Education  Research 
(J  Conference,  Montreal,  Canada,  April  5,  I973. 
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Opifilon  leaders  are  defined  as  those  Individuals  from 
v;hom  others  seek  ac'.vlce  and  Information,    Rogers  said 
they  are  most  often  members  of  the  social  system  In  vrtilch 
they  exert  their  influence.    These  persons  channel  infor- 
mation by  personal  coramimication  to  their  followers. 

Studies  have  been  made  regarding  the  adoption  of 
farm  practices,  medical  practices,  power  structures  of 
communities,  education  and  the  like,    A  great  deal  is 
known  about  the  social  and  personal  characteristics  of  opinion 
leaders  among  the  middle  class.    Corresponding  studies 
directed  toward  the  identification  of  opi^nion  leaders 
among  the  low  Income  are  conspicuously  lacking. 

Beavers    said  the  cooperative  Extension  Service, 
in  helping  low  socioeconomic  families,  must  involve  the 
people  directly  in  helping  themselves.    Although  their 
leadership  was  not  readily  recognized,  it  did  exist. 

brown  and  March^  suggested  one  goal  of  Extension  in 
working  with  the  low  income  would  be  to  work  with  '*ay 
leaders  and  others  in  the  communit'^^  in  developing  an 
attltudinal  climate  that  would  encourage  participation 
in  educational  training  programs  and  vrould  encourage 
local  people  to  seed  appropriate  assistance  from  all  agencies • 

The  Study 

The  present  study  was  an  early  attempt  at  identifying 
persons  vrtio  are  opinion  leaders  in  family  living  among 
low  Income  homemaiers.    The  study  Identified  the  personal 
and  social  characteristics  of  these  leaders. 

To  accomplish  the  major  purpose  of  this  study,  answers 
to  the  following  questions  were  sought: 

1.  To  vrtiat  extent  did  opinion  leaders  exist  among 
low  income  homemakers? 

2.  Did  opinion  leaders  among  the  lov;  income  homemakers 
have  more  formal  education  than  lo::  Income  homemakers 
who  were  not  opi  li^/a'^leaders? 


Everett  M.  Rogers ;  Dlx fusion  of  Innovations  (New 
York:    The  Free  Press  of  Glencoe,  19^2),  p.  lb. 

^Irene  Seavers,  "The  Disadvantaged •    Journal  of 
Cooperative  Extension^  III  (Vlinter  1965;^  p.  237. 

^Minnie  M.  Brov/n  and  C.  Paul  Marsh,  "Extension  and 
Poverty,  "Journal  of  Cooperative  Extension,  III  (Fall  19^5)^ 
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3.  Did  opinion  leaders  among  low  income  homemakers 
have  a  higher  socioeconomic  status  than  low  income 
homemakers  vrtio  vrere  not  opinion  leaders? 

4,  Did  opinion  leaders  among  the  low  income  home- 
■  makers  make  more  extensive  use  of  mass  media 

than  low  income  homemakers  who  were  not  opinion 
leaders? 

5.  Did  opinion  leaders  among  low  income  homemakers 
have  a  higher  income  than  low  income  nomemakers 
vrtio  were  not  opinion  leaders? 

6,  Were  opinion  leaders  among  low  income  homemakers 
older  than  low  income  homemakers  who  were  not 
opinion  leaders? 

i 

7-    Did  opinion  leaders  among  low  income  homeuiakers 
seek  advice  and  information  from  the  same  personal 
sources  (kin,  neighbors,  professionals  or  other) 
as  low  income  homemakers  who  were  not  opinion  leaders? 

8.  Did  opinion  leaders  live  within  the  immediate 
neighborhood? 

9.  Was  there  a  relationship  between  the  age,  education 

and  income  of  the  homemakers  and  their  personal  

sources  of  information  and  use  of  mass  media? 

Procedures  for  the  Study 
Population  and  Sample; 

The  initial  target  population  of  this  study  was  the 
low  inccae  homemakers  \jho  ;rere  participating  in  the  expanded 
food  pnd  nutrition  program  in  Ohio.    Sixteen  counties  had 
been  in  the  program  since  its  inception  in  November  1968, 

The  procedure  for  selecting  the  sample  for  this  study 
was  of  a  multi-stage  nature.    In  phase  one,  a  random  sample 
of  one  county  was  drawn  from  the  16  counties  that  had  been 
in  the  program  since  its  inception.    Prom  this  sample, 
geographic  areas  in  the  county  were  identified  and  a 
stratified  random  sample  of  low  income  homemakers  was  drawn 
from  each  geographic  area.    The  sampling  unit  vxas  the 
low  income  homemaker.    The  geographic  area  was  further 
stratified  by  the  number  of  aides  working  with  low  income 
homemakers  in  the  EPNEP  program. 

The  total  population  in  the  Hamilton  County  expanded 
Food  and  Nutrition  program  was  295  homemakers.    The  sample 
size  was  I50  homemakers.    The  295  homemakers  were  stratified 
into  four  areas  of  the  county.    The  number  of  cases  drawn 


from  each  stratum  was  based  on  the  number  of  cases  in  each 
of  the  four  strata  in  relation  to  the  total  population 
and  size  sample. 

The  sampling  unit  for  phase  two  of  the  study  was  the 
total  population  of  the  opinion  leaders  identified  in  phase 
one  of  the  study.    Only  30  were  identified. 

Design; 

This  study  was  descriptive  in  nature.    It  described 
the  characteristics  of  lovr  income  homemakers  as  they  related 

education5  socioeconomic  status ^  sources  of  advice  and 
information^  income,  a^e^  ar.a  residence.    It  also  compared 
the  opinion  leaders  with  non-opinion  leaders. 

Data  to  be  Collected; 

The  data  collected  vrere  based  on  the  research  that 
had  been  published  relative  to  opinion  leadership  In  other 
studies.    Much  of  this  vjas  oriented  toward  personal  and 
social  characteristics  of  the  middle  class.    Yet,  the 
research  Implied  opinion  leaders  were  found  In  all  social 
systems  and  Implications  were  that  the  characteristics 
might  be  the  same  for  all  classes. 

The  data  sought  Included; 

1.  Age  -  at  last  birthday. 

2.  ^orm.  1  Education  -  Highest  grade  completed 
3*    Annual  income  -  Included  sources  of  income. 
4.    Racial  origin 

5«    ^arltarjr  status 

6.    Number  of  marriages 

?•    Who  3.1  ves  with  the  homemaker 

8.  ^ass  media  sources  of  Information  -  included 
frequency  use  of;    oooks,  magazines,  nevxspapers, 
radio  and  television  programs. 

9.  Socioeconomic  status  -  as  measured  on  a  socioeconomic 
status  scale  that  was  developed. 

10.    Opinion  leader  identification  -  based  on  10  hypo- 
^et-'.cal  situations  that  sought  first  choice  of 
person  from  vihom  J-y  requested  advice  and  informa- 
tion.   Additional  Li  format  ion  about  wiio  they  were^ 
^at  they  dld^  at.d  where  they  lived  was  requested. 
(Examples  of  Questions) 

Self -designation  opinion  leauer  identification  - 
iTsix-item  scale  wias  constructed,  based  on  Roge r s 
six-item  questions  for  self-identification. 

Instruments ; 


After  revlevTlng  some  social-status  scales.  It  was 
deemed  essential  that  an  Instiximent  be  constructed  for  use 
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in  this  study.2^  The  idea  was  gleaned  from  Chapin's  "Social 
status  scale."      Several  persons  were  interviewed  who  had 
worked  closely  with  low  income  homemakers.    A  19-item  scale 
was  constructed  and  pretested  with  a  group  of  10  homemakers 
in  Cincinnati.    An  analysis  was  made  of  the  results.  No 
items  were  dropped,  because  all  those  interviewed  did  not 
have  the  same  items.    Two  more  items  were  added. 

The  standard  deviation  was  calculated  and  all  those 
falling  within  the  standard  deviation  were  given  a  score 
of  one  and  those  above  were  given  a  score  of  two.    The  items 
with  a  score  of  two  were:    colored  television,  electric  blender, 
electric  mixer,  and  electric  skillet.    None  fell  below  the 
standard  deviation. 

A  standard  deviation  of  the  socioeconomic  scale  was 
calculated  for  both  the  homemakers  and  opinion  leaders  and 
then  the  two  were  averaged.    The  nmber  to  be  included 
below  the  standard  deviation  and  those  above  was  ctilculated. 
Six  socioeconomic  groupings  were  developed,  based  on  income 
and  material  possessions.    They  were: 

low  income  -  low  material  possessions 
Low  income  -  medium  material  possessions 
Low  income     high  material  possessions 
High  ■'ncome  -  low  material  possessions 
High  income  -  medium  material  possessions 
High  income  -  high  material  possessions 

A  questionnaire  was  constructed  that  incorporated  the 
data  to  be  collected  and  instruments  to  be  used.    It  was  to 
be  used  in  both  phases  of  the  study: 

Phase  I:    With  low  income  homema!-:ers  to  identify 
opinion  leaders. 

Phase  II:    With  identified  opinion  leaders  to  identify 
their  persona,   and  social  characteristics. 

The  interview  schedule  was  pretested  by  two  aides 
with  ten  homemakers  in  the  expanded  Food  and  Nutrition  Program 
in  Hamilton  County.    A  conference  was  held  with  these  trained 
interviewers  to  discuss  problems  of  administration  of  the 
schedule  and  recommended  changes.    Surprisingly,  the  only 
recommended  changes  were  the  addition  of  tvro  items  to  part  III 
of  the  questionnaire  which  vis/s  the  socioeconomic  scale  that 


Delbert  C.  Miller,  Handbook  of  Research  Design  and 
Social  Measurement  (Nev;  York :    David  McKay  Company,  Inc., 
1904;,  pp.  114-115. 
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v;as  developed  and  pretested  for  the  study.    The  review  of 
the  completed  questionnaires  with  the  interviewers  convinced 
the  vrriter  to  make  no  revisions  except  adding  teleDhone  and 
washingmachlne  to  part  III,  which  was  the  list  of  material 
possessions. 

How  data  were  collected i  *    * ' 

Ten  nutrition  aides  who  were  employed  by  the  extension 
service  in  Hamilton  County  x^ere  the  interviewers  for  the 
study.    One  prerequisite  was  that  they  had  been  employed 
for  at  least  three  months  e.s  aides.    The  reason  they  were 
chosen  to  interview  the  homemakers  was  the  fact  they  had 
already  established  rapport^  and  it  was  felt  the  respondents 
would  cooperate  more  extensively. 

A  manual  of  instructions  for  interviewers  was  developed 
and  interviewers  were  trained.    Each  aide  ms  asked  to  make 
three  interviews  and  then  another  conference  was  held  with 
each  aide  before  completing  the  remaining  interviews. 

Each  aide  was  asked  to  interview  from  10-23  families. 
The  number  was  based  on  the  number  of  homemakers  in  the 
stratum  in  proportion  to  the  sample  v/hich  was  explained 
earlier.    Each  schedule  was  reviewed  for  incompleted  questions 
or  questionable  responses.    The  interv5.ewers  were  asked  to 
follow  up  on  those  un.completed  schedules.    One  hundred  thirty-one 
schedules  were  completed  and  returned. 

After  Phase  I  v;as  completed,  the  intervic;f  schedules 
were  prepared  for  the  computer  according  to  a  code  book  that 
had  been  developed  earlier  for  co:nputer  reporting. 

A  sociometric  tabulation  form  was  constructed  to  use  in 
giving  a  total  picture  of  e31  the  Homemakers^  responses  for 
choices.    The  chooser  (horn-: \aker)  and  chosen  (opinion  leader) 
were  identified.    Those  persop.s  named  tv/o  times  or  more  by 
persons  were  considered  to  be  opinion  leaders. 

The  questionnaire  was  revised  slightly  for  Phase  II 
of  the  study  so  that  the  questions  would  be  applicable  to 
men^  as  well  as  women • 

Thirty  influentials  were  identified  and  19  of  these 
were  interviewed  by  aides.    The  remaining  11  received  a 
mailed  questionnaire.    The  professionals  identified  were 
contacted  by  this  method. 

Note  there  was  a  difference  between  the  percentage  of 
response  of  the  Homemakers  {8?%)  and  the  opinion  leaders  {Sjfo). 
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Hypotheses ; 

Related  literature  research  provided  the  basis  for 
the  following  hypotheses : 

1.  Opinion  leaders  Identified  by  the  low  Income 
homemakers  attained  a  significantly  higher  educational 
level  than  low  Income  homemakers  ^o  v:ere  not  opinion 
leaders  • 

2.  Opinion  leaders  Identified  by  the  low  income  home- 
makers  were  significantly  older  than  the  low  Income  homemakers 
who  were  not  opinion  leaders, 

3.  Opinion  leaders  Identified  by  the  low  income 
homemakers  had  a  significantly  higher  socioeconomic  status 
than  the  low  income  homemakers  ^fiho  were  not  opinion  leaders. 

4.  Opinion  leaders  Identified  by  the  low  income  home- 
makers  made  a  significantly  greater  use  of  mass  media  than 
the  low  Income  homemakers  who  were  not  opinion  leaders • 

5#    Opinion  leaders  iden-^.ified  by  the  low  incomehome- 
makers  had  a  significantly  :n-:.g:her  Income  than  the  low  income 
homemakers  \riio  were  not  opiriJon  leaders. 

6.    Opinion  leaders  iJirntified  by  the  low  Income 
homemakers  sought  advice  and  information  from  slgnificajitly 
different  personal  soixrces  (kin,  neighbors,  professional  or 
other)  than  the  low  ixicome  homemakers  who  were  not  opinion 
leaders. 

Analysis  of  the  study; 

The  study  was  analyzed: 

I    To  Identify  opinion  leaders  through  socio- 
metric  choice  when  identified  two  times 
or  more 

The  tabulation  form  was  shovjn  earlier  that  gave 
a  total  picture  of  all  the  homemakers'  responses  for 
choices.    Tliose  persons  named  two  times  or  more  by  persons 
were  considered  to  be  opinion  leaders. 

Whenever  a  group  is  soclometrlcally  tested  for 
choices,  they  are  unevenly  divided  among  the  members  of 
a  group,  regardless  of  size  or  kind.     ••The  llon^s  share 
is  distributed  among  a  few.    The  majority  get  an  average 
number  of  choices.    The  proportion  of  isolates  is  greater 
than  the  proportion  of  starj3."lO 


ERJC  J.L.  Moreno,  The  Soc-»ometiy  Reader  (Glencoe, 

Illinois:    The  Free  Press ;'T9oO)'',  p.  70. 
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Thirty  persons  were  named  in  the  study  by  two  or 
more  of  the  homemakers  as  sources  of  advice  and  informa- 
tion for  the  10  hypothetical  questions.    Ten  different 
persons  were  named  whom  the  homemakers  would  contact 
for  two  or  more  questions.    However,  the  majority  said 
they  would  contact  different  persons  for  each  question. 
Merton     found  that  leaders  are  generally  monomorphic, 
i.e.  different  opinion  leaders  for  different  services. 
Rogers  and  Van  ES-'-^  postulated  that  opinion  leadership 
in  traditional  societies  was  more  polymorphic  than  mono- 
morphic,  i.e.  one  leader  who  advised  on  more  than  one 
subject.    Both  kinds  of  leadership  were  evidenced  in  this 
study.    Nevertheless,  monomorphic  was  more  predominant. 

One  person  was  named  2-1  times  by  different  homemakers; 
a  second  was  named  18  times. 

On  a  single  question,  the  largest  number  of  different 
persons  named  was  nine. 

The  study  concurred  with  Moreno's  philosophy  that 
the  majority  get  an  average  number  of  choices  and  the  lion's 
share  is  distributed  among  a  few. 

II  To  identify  opinion  leaders  through  a  self -designated 
technique  by  four  or  more  items  on  the  scale 

The  self -designating  leadership  scale  was  scored  in  the 
following  manner: 

1.  During  the  past  six  months  have  you  told  another 
homemaker  about  something  that  will  help  her  as 
a  homemaker:    Yes  (1)    No  (0) 

2.  Compared  with  your  friends,  (a)  are  you  more  or 
(b)  are  you  less  likely  to  be  asked  ideas  about 
homemaking?    More  (1)  Less  (0) 


Elihu  H.  Katz  and  Ppui  P.  Lazersfeld,  Personal 
Influence:    The  Part  Played  by  People  in  the  B'low  of  Mass 
Commimication  (New  York;    t'rh e  Press,  19b4),    pp.  59-61. 

"^Everett  M.  Rogers  and  Jonannes  C.  Van  Es,  Opinion 
T^adership  in  Traditional  and  Columbian  Peasant  Communities 
V - ast  Lanping,  Michigan:    Department  of  Communication,  Michigan 
St,,  e  University,  1964),  p.  19. 
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3.  Thinking  back  to  the  last  time  you  talked  with 
your  friends  about  homemaking^  (a)  were  you  asked 
v*iat  yov.  thought  about  it  or  (b)  did  you  ask 
someone  else?    Was  asked  (1)  asked  someone  else  (0) 

4.  Wien  you  and  your  friends  discuss  ideas  about 
housekeeping,  what  do  you  do?    Mainly  listen(O) 
t3:y  to  get  them  to  accept  you  ideas  (1) 

5»    Which  of  these  happens  more  often:     (a)  do  you 
tell  your  neighbors  about  something  that  will 
help  them  as  homemakers  or  (b)  do  they  tell  you 
about  something  that  will  help  you  as  a  homemaker? 
I  tell  them  (1)    They  tell  me  (0) 

6.    Do  you  have  the  feeling  that  you  are  generally 
regarded  by  your  friends  and  neighbors  as  a  good 
source  of  advice  aoout  homemaking?    Yes  (1)    No  (0) 

Those  having  scores  of  four  or  more  points  were  considered 
as  perceiving  themselves  to  be  opinion  leaders.  Conversely, 
those  having  a  score  lower  than  four  points  were  assumed  not 
to  perceive  themselves  as  opinion  leaders.  Thirty-seven 
percent  of  the  homemakers  self -designated  themselves  as 
opinion  leaders. 

Ill    Through  frequency  distribution  of  age 5  level 
of  education,  level  of  income 5  level  of  socio- 
economic status 3  sources  of  infomiation^  and 
residence 

An  analysis  was  made  of  the  education,  age,  and  use 
of  mass  media  by  those  homemakers  who  identified  themselves 
as  being  leaders  on  the  self-designated  opinion  leadership 
scale. 

Fifty-seven  percent  of  those  designating  themselves 
as  opinion  leaders  were  between  the  ages  of  30  and  50. 

As  education  increased,  the  percentage  increased  xintil 
45  percent  of  those  with  an  education  of  10-12  grades  desig- 
nated themselves  as  leaders. 

Forty-eight  percent  of  those  identifying  themselves 
as  leaders  had  an  income  ranging  from  $2,000  -  $3,999* 

The  homemakers  in  the  ctudy  who  designated  themselves 
as  opinion  leaders  reported  reading  magazines  as  being  the 
least  source  of  advice  and  information  and  reading  newspapers 
as  their  greatest  source.    More  pe'^'^o^s  listened  to  the 
radio  than  watched  television.     ,      radio  wa.s  the  greatest 
^  daily  source  of  information,  but    ^xevislon  was  reported 
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most  as  never  being  a  source  of  information  in  this  portion 
of  the  study. 

An  analysis  was  made  of  those  responses  made  by  the 
homemakers  who  named  persons  they  would  go  to  as  a  source  of 
information  in  homemaking  (response  to  the  hypothetical 
situations).    The  homemakers  did  not  make  neighbors  as  their 
greatest  source  of  advice  and  information  but  were  inclined 
to  name  persons  who  lived  more  than  five  blocks  away.  Neither 
were  relatives  mentioned  to  a  large  extent:  however^  the 
relative  named  the  most  was  the  husband.    The  professional 
technical  persons  were  mentioned  the  most, 

IV    Lastly^  the  study  v^as  analyzed  for  difference 
of  groi:?)s  by*  chi- square, 

A  comparison  was  made  of  the  differences  between  the 
opinion  leaders  and  homemakers  as  they  related  to  selected 
variables — age^  education^  income^  personal  sources  of  in- 
formation^ socio-economic  level  and  use  of  mass  media. 

For  example^  an  analysis  of  the  data  pertaining  to  age 
indicated  the  largest  number  of  both  homemakers  and  the  opinion 
leaders  was  between  the  ages  of  30  and  59»    The  differences 
in  frequencies  were  not  significant  at  the  ,05  level  when 
the  chi-square  statistic  was  applied.    On  the  basis  of  the 
analysis  of  the  data^  the  null  hypothesis  was  accepted. 

On  the  other  hand^  the  data  collected  from  the  homemakers 
and  opinion  leaders  as  to  educational  level  indicated  15 
of  the  20  opinion  leaders  had  completed  10  or  more  years  of 
formal  education^  vrtiereas  only  58  of  the  131  homemakers  had 
completed  the  same  years  of  education.    The  differences  in 
frequencies  were  significant  at  the  ,05  level  when  the 
Chi- square  statistic  was  applied  to  the  data, 

A  comparison  was  made  of  i^he  age,  education,  and  income 
levels  of  the  homemakers  in  this  study  with  their  personal 
sources  of  information  and  use  of  mass  media  as  a  source 
of  information.    This  phaso  of  the  study  was  also  analyzed 
difference  of  groups  by  chi-scuare, 

^^vr-r^ary 

The  speaker  was  asked  to  concentrate  on  process  rather 
than  results;  consequently^  very  little  time  has  been  allocated 
to  this  area  except  as  a  means  of  illustrating  a  procedure. 
The  results  would  require  another  lengthy  presentation. 

The  study  represented  an  attempt  to  learn  whether  or  not 
opinion  leadership  existed  among  low  income  homemakers 
and^  if  so,  to  identify  selected  personal  and  social  charac- 
tex'istics  of  those  from  whom  low  incomehomemakers  sought 
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advice  and  information  in  family.    In  revievr^  you  recall 
a  sample  of  I50  homemakers  vas  selected^  and  30  opinion 
leaders  were  chosen.    Major  findings  were  reported.  Con- 
clusions^ implications  ana  recommendations  were  made^  both 
as  they  related  to  the  expanded  food  and  nutrition  program 
and  recommendations  for  further  study. 


^^^^^^^^^ 


WHAT  CAN  WE  LEARN 
FROM  EVALUATING  AN  EVALUATION?* 

Can  other  people's  evaluation  experiencen  help  us  loam  about  the  sound- 
ness of  beliefs  and  assumptions  about  evaluation?    We  feel  it  can.  Further- 
more, federally  funded  projects  provide  a  tremendous  arena  for  testing 
commonly  held  beliefs  and  assumptions. 

This  paper  looks  at  how  one  major  federally  funded  "innovative"  adult 
education  program.  Rural  Family  Development  (RFD),  was  evaluated  to  learn 
more  about  evaluation.    Although  RFD  was  a  University  of  Wisconsin-Extension 
program,  we  had  no  direct  involvement  with  it  or  with  its  evaluation.  Our 
paper  is  limited  to  information  provided  in  official  project  reports. 

Our  purpose  isn't  to  evaluate  RFD  or  primarily  to  critique  the  evaluation 
that  was  done.    Our  probing  focuses  on  the  basic  concepts  and  beliefs  under- 
lying the  project's  evaluation. 

•  The  overall  evaluation  strategy  was  decided  in  1969  before  newer  ideas 
about  evaluation  had  received  much  circulation.  It's  quite  typical  of  many 
evaluation  efforts  that  were  made  during  the  1960s  in  the  following  respects: 

1.  Evaluation  was  contracted  to  research  experts  and  basic 
decisions  were  made  by  them. 

2.  The  internal  evaluators  provided  numerical  descriptions  of  results 
but  made  little  or  no  effort  to  see  that  judgments  were  made  using 
those  results. 

3.  Objectives  were  the  only  framework  used  in  organizing  the  evaluation. 
Just  as  the  RFD  project  is  probably  no  more  or  no  less  successful  than 

many  other  innovative  projects^  so  the  evaluation  is  probably  no  stronger  and 
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no  weaker  than  most  other  evaluations  that  were  made  during  the  same  period • 
In  most  cases  hindsight  is  clearer  than  foresights 

Before  going  further  in  our  examination  of  the  RFD  evaluation  activities, 
we  will  try  to  give  you  some  background  material  on  (1)  the  project  itself, 
and  (2)  the  evaluation  procedures  used* 

An  Overview  of  RFD  and  Its  Evaluation 

The  RFD  Project 

The  project  was  designed  to  test  an  integrated  delivery  system  that 
might  have  many  kinds  of  applications  but  particularly  home-based  continuing 
education  for  adults.^    It  combined  educational  television,  individualized 
home-study  instruction  techniques,  and  personalized  home-contact  instruction. 
The  RFD  project  applied  this  concept  to  helping  disadvantaged  rural  adults 
build  coping  skills. 

T!ie  ten  objectives  of  the  project  were  as  follows: 

1.  Demonstrate  the  effectiveness  of  an  integrated  television,  home 
study,  home  contact  and  visit  program  for  rural  Adult  Basic  Educa-- 
tion  (ABE)  students. 

2.  Demonstrate  the  effectiveness  of  the  role  of  mass  media  in  rural 
ABE  programs. 

3.  Create  a  viable  television-based  multimedia  program  useable  in 
similar  situations  in  other  parts  of  the  country. 

M-.    Demonstrate  the  effectiveness  of  an  interdisciplinary  family 
and  community  oriented  approach  to  rui»al  ABE  programs. 

5.  ivolve  large  numbers  of  undereducated  adults  not  now  able  or 
Milling  to  participate  in  ABE  programs. 

6.  Develop  a  program  that  will  improve  ABE  instruction  while  maintaining 
•  the  lowest  possible  cost  per  pupil. 


1.    The  RFD  Project,  A  Summary  Report  of  the  Development,  Field  Testing 
and  Evaluation  of  a  Multimedia  Program  in  Continuing  Education  for  Adults, 
the  University  of  Wisconsin  System  (1972). 


7.  Assist  in  the  development  of  skills  tH&t  can  lead  to  new  careers  for 
home-study  aides  and  other  staff  inerbers. 

8.  Demonstrate  .he  involvement  of  disadvantaged  individuals  in  the 
development  and  implementation  of  such  a  program. 

9.  Develop  participant  skills  in  the  basic  fields  of  communication 
and  computation  while  improving  the  capability  of  the  target 
audience  to  exercise  citizenship  responsibilities. 

10.    Develop  participant  skills  from  present  proficiency  towaacKi  eighth 
grade  and  twelfth  grade  equivalency  achievement  levels. 

NOTE:    These  objectives  appear  in  the  final  report  only  in  the  section 
indicating  the  external  ev=iluators  view  of  attainment. 

The  project  was  funded  for  three  years;  the  first  year  was  used  for 
development,  the  second  for  implementation,  and  the  third  for  evaluation.  The 
total  funding  was  $740,000,  of  which  64  percent  was  spent  on  development 
21  percent  on  delivery,  and  14  percent  o*"3  research  and  development  activities. 
Or,  looking  at  the  expenditures  another  way,  39.2  percent  went  into  materials 
26  percent  into  television,  17  percent  into  home  visits,  and  17  percent  into 
other  components.    The  actual  demonstration  phase  that  tested  the  system  was 
conducted  for  a  20  week  period  during  the  winter  and  spring  of  1970  in  the 
WHA  Madison  viewing  area  with  the  target  area  identified  —  ^our  rural  counties 
in  southcentral  Wisconsin.    The  system  used  six  major  components:    a  weekly 
half-hour  TV  show;  a  wide  array  of  information  bulletins;  personal  contact  in 
the  form  of  weekly  home  visits;  a  weekly  radio  program;  a  monthly  ALMANAC 
(newsletter)  and  ACTION  LINE;  and  a  toll  free,  24-hour  telephone  service  for 
answering  questions  and  requests  for  materials. 

During  the  demonstrations  the  project  cost  about  $8,326  a  week.  This 
figure  doesn't  include  such  things  as  development  of  materials  except  for 
those  done  on  a  weekly  basis,  administration,  ots'^.. 

Approximately  one-quarter  of  the  total  adult  audience  in  the  project 
area  viewed  one  or  more  of  the  television  programs.    Over  1,700  adults 


requested  follow-up  materials*    ACTION  LINE  handled  1,641  inquiries ♦  Over 
11,000  bulletins  were  distributed. 

The  Evaluation 

About  4  percent  of  the  total  budget,  $27,500,  was  spent  on  evaluation. 
Most  of  the  evaluation  budget  was  spent  in  preparation  and  follow-up  activities 
with  only  about  $2,000  being  categorized  as  costs  during  delivery,  and  $3,900 
labeled  as  research  and  creation  costs  while  the  program  was  being  conceptualized* 

The  evaluation  activities  included  thr*^e  types  of  personnel:    (1)  a 
project  staff  position  with  evaluation  responsibilities  which  had  a  personnel 
change  about  a  third  of  the  way  through,    (2)  personn'  1  from  a  UW  psychometrics 
laboratory  who  were  labeled  as  an  internal  evaluation  team  even  though  they 
were  internal  to  the  University  of  Wisconsin  system  but  weren^t  an  integral 
part  of  the  RFD  program  staff,  and  (3)  an  external  evaluation  team  from 
a  western  university's  research  laboratory.    Gwly  the  internal  staff  member 
was  from  the  academic  field  of  adult  education.    Although  the  views  on 

/aluation  of  two  professors  of  adult  education  were  quoted  in  the  newsletter 
to  professionals,  there  was  no  indication  that  either  of  them  or  the  RFD 
staff  member    actually  influenced  the  design  of  the  evaluation. 

The  U.S.  Office  of  Education  indicated  that  the  psychometrics  staff 
would  be  a  credible  source  in  evaluation  and  most  of  the  decisions  about  the 
evaluation  appear  to  have  been  made  by  that  staff.    They  seemed  to  interpret 
their  evaluation  role  as  that  of  providing  numerical  data  about  the  program. 
Little  evidence  exists  to  show  that  the  project  staff  or  the  psychometric 
staff  concentrated  on  the  criteria  and  judgments  necessary  in  utilizing  that 
data.    The  final  report  indicates  that  the  internal  evaluators  provided  the 
following  kinds  of  data:    results  of  a  Qontvolled  experiment  examining  the 
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effect  of  the  home-viaitor  component  of  the  programs;  evaUationo  of  tele- 
vision  tapes  and  publioaHono;  telephone  aurvivja  of  pavUoipanU,  the  target 
population,  and  a  random  selection  from  the  larger  audience  carried  out  by 
the  Survey  Research  Laboratory;  a  termination  survey  report;  and  an  evaluation 
of  effectiveness  of  home  visitors. 

The  only  area  where  RFD  staff  members  seemed  to  be  in  charge  of  the 
evaluation  was  in  the  original  need  assessment.    In  carrying  out  this  eval- 
uation they  first  had  the  Survey  Research  Laboratory  do  a  telephone  survey 
and  then  involved  potential  clientele  in  a  card-sort  to  identify  areas  of 

most  perceived  need. 

The  external  evaluators  (a  team  of  five  that  included  representatives 
from  educational  media,  vocational  education,  economics,  psychology,  and 
education)  suramatively  explored  validation.    They  were  asked  to  do  the 
following: 

\.    Review  the  accomplishments  of  the  project  in  design,  field 
testing,  and  eveduation. 

2.  Assess  the  extent  to  which  the  project  achieved  its  objectives , 

3.  Assess  the  extent  to  which  data  collection  had  been  adequate  to 
the  requirements  of  the  research. 

4.  Assess  and  make  judgments  about  the  design  and  execution  of  the 
ir  internal  research. 

5.  Relate  cost  to  accomplishments. 

6.  Prepare  a  report  that  will  be  readily  incorporatef?  Irito  the 
fxiial  project  report. 

The  external  evaluators  spent  several  days  in  Wisconsin  study "ng  data 
and  other  materials  and  talking  with  participants,  staff,  and  other  University 
of  Wisconsin  faculty  members.    However,  they  didn't  collect  any  additional 
numerical   data.    Kor  did  they  systematically  develop  any  specific  criteria 
except  to  carx    out  their  assignment  of  assessing  the  extent  to  which  the 
O  .  project  achieved  its  objectives. 

ERjC 


Establishing  Criteria  for  Analyzing  the  RFD  Evaluation 

Vrfe  believe  evaluation  is  a  process  by  which  judgments  are  formed  by 
comparing  evidence  with  criteria.    In  this  instance  the  evidence  was  the 
information  provided  in  the  final  report.    We  made  many  judgments  as  we 
read  the  raport.    But  what  criteria  were  we  using?    What  criteria  should 
we  be  using? 

We  decided  we  could  use  criteria  drawn  from  one  or  more  of  the  following 
sources : 

1.  The  criteria  customarily  associated  with  the  kind  of  evaluation 
approach  used  in  the  project. 

2.  Criteria  suggested  in  more  recent  concepts  of  evaluation. 

3.  Criteria  reflecting  what  we  as  individuals  believe  is  valuable 
in  evaluation. 

We  faced  the  question  of  whether  it  is  fair  to  evaluate  evaluation 
operational! zing  one  concept  of  evaluation,  using  criteria  drawn  from  a 
different  concept  of  evaluation.    We  decided  it  ;^as  faij?  and  appropriate 
if  we  also  evaluated  the  evaluation  using  the  criteria  usually  associated 
with  the  operationalized  concept.    The  literature  on  evaluation  includes 
relatively  few  stated  criteria,  so  we  also  decided  it  might  be  profitable 
to  try  to  state  the  criteria  we  were  applying  in  our  instant  judgments 
while  studying  the  report.    Therefore,  we  will  present  and  discuss  our 
judgment i  of  the  evaluation  using  a  wide  range  of  criteria. 

Criteria  Customarily  Associated 
With  the  Type  of  Evaluation  Used 

Two  types  of  criteria  usually  are  associated  with  the  kind  of  approach 

used  in  the  evaluation  of  RFD.    The  first  deals  with  the  extent  to  which 

the  evaluation  centers  on  the  objectives.    The  other  deals  with  scientific 
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criteria  of  validity,  reliability,  and  objectivity. 

Criterion  I:  Does  the  evaluation  address  itself  to  the  attainment 

of  the  program  objectives? 
EVIDENCE 

Internal  Eva.Luation*  The  internal  evaluation  team  con- 
centi^ated  their  examination  of  r'^-;ults  by  coraparing  the 
data  of  38  families  who  had  worked  with  home  visitors  with 
the  data  of  29  families  who  hadn't  been  contacted   by  home 
visitors.    Both  groups  came  randoiiily  from  the  same  original 
list  of  low  income  families. 

The  report  indicates  that  expected  behavioral  outcomes 
were  used  as  a  basis  for  developing  a  specially  designed 
and  validated  test  consisting  of  six  subscales.    They  were 
also  used  ais  the  basis  for  a  self- assessment  of  how  much 
was  learned.    Mean  scores,  standard  deviations,  and  levels 
of  significance  were  reported  for  the  tests;  the  number  of 
people  indicating  various  amounts  of  learning  were  given  in 
the  final  repca?t.    In  neither  case  was  the  meaning  of  the 
findings  discussed. 

External  Evaluation.    The  external  evaluators  judged 
the  attainment  of  each  objective  (listed  on  pages  2  and  3) 
using  five-point  scales — five  indicating  a  high  degree  of 
attainment.    The  objectives  and  their  ratings  were  as  follows 
Objective  Rating 

1 

2 
3 
if 
5 
6 
7 
8 
9 

10 


3.0  -  3.5 
3.5  -  U.O 
3.5  -  4.0 
3.0  -  3.5 
4.0  -  4.5 
1.0  -  1.5 
3.5  -  4*0 
3.0  -  3*5 
2.0  -  2*5 

1.0  -  1,5 
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Ratings  on  the  attainment  of  the  objectives  were  such  that 
the  external  evaluators  gave  the  project  a  global  rating  of 
2.8  to  3.2  on  a  five-point  scale. 

JUDC^T 

Both  the  internal  and  external  evaluators  addressed  them- 
selves tc  the  objectives  but  their  approach  to  evaluating  them 
was  far  from  complete • 

DISCUSSION 

1.  The  internal  evaluation  considered  only  microlevel  objectives 
(specific  behaviorcil  outcomes).    It  made  no  attempt  to  evaluate 

the  program  in  terms  of  its  program  objectives.    We  feel  the 
behavioral  outcomes  didn^t  adequately  sample  the  pro<5ram 
objectives.    Therefore,  by  dealing  only  with  behavioral 
outcomes  the  internal  evaluators  didn*t  adequately  fulfill 
their  responsibility  related  to  the  project  obje-tives. 

2.  The  in-^emal  evaluators  dealt  with  group  change  rather  than 
individual  change.    Mean  scores  on  the  tests  were  used 
rather  than  the  number  or  percent  of  people  making  adequate 
amounts  of  gain  on  particul.j?  objectives.    Ancilysis  of 
individual  gains  is  more  appropriate  in  a  program  like  the 
RED  program,  which  emphasized  individual  differences  and 
participants  who  were  free  to  pursue  the  particular  parts 
that  interested  them.    The  traditional  approach  to  analyzing 
the  attainment  of  objectives  is  built  on  essent?.alistic 
approaches  to  education.    It*s  less  appropriate  in  programs 
that  allow  for  participant  selection  of  what  is  to  be 
learned . 

O 

ERLC 
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3.    The  internal  evaluators  presented  no  conclusions.  They 
only  reported  findings.    There's  no  evidence  as  to  whether 
they  or  the  project  staff  felt  the  specific  outcomes  had 
been  met.    We  feel  evaluation  should  include  summative 
judgments  indie  "ring  what  the  data  mean. 
The  internal  evaluation  v.as  built  on  the  original  plan  for 
the  program  and  didn't  adjust  when  the  program  changed  from 
basic  reading  and  math  skills  to  something  called  "life 
coping  skills."    Therefore,  the  data  gathered  wasn't 
particularly  germane  to  the  operationalized  objectives. 
However,  life  coping  skills  weren't  adequately  described 
by  the  staff,  and  we  are  thus  left  with  questions  about 
what  coping  objectives  received  major  attention  in  the 
pro-am  and  whether  or  not  the  attention  pa:.d  off. 

5.  The  external  evaluators  were  asked  to  form  judgment.*^  ratner 
than  to  do  measurements.    As  a  result  they  were  evaluating 
in  thi  way  we  believe  the  term  should  be  used.  However, 
some  judgments  lack  supportive  evidence  because  resources 
didn't  permit  gathering  additional  results  data. 

6.  The  external  evaluators  didn't  communicate* their  framework 
for  coping  with  the  ten  objectives  (listed  on  pages  2  and 
3)       coming  up  with  an  overall  score.    It's  not  clear 
whether  the  objectives  were  equally  weighted  or  if  some 
were  weighted  more  heavily  than  others.    In  oxir  judgment, 
the  objectives  shouldn't  have  been  equally  weighted. 
However,  the  weighting  probably  will  vary  with  the  per- 
spectives of  those  involved. 

ERIC 
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Since  the  program  was  funded  through  Adult  Basic  Education 
monies,  one  perspective  would  hold  that  the  project  should 
•  — be^judged  primarily  on  its  attainment  of  the  objectives 

relating  specif ically- to  adult  basic  education.    If  the  weighting 
was  heaviest  on  objectives  6,  9,  and  10,  there's  veiy  little 
evidence  that  the  program  was  successful  in  providing  ABE. 
Viewed  from  the  perspective  of  those  generally  interested  in 
adult  education,  objectives  1  and  3  probably  are  the  most  a?ucial# 
There's  also  little  evidence  thai:  these  objectives  were  met 
if  the  obj^'ctives  are  interpreted  in  terms  of  the  unique 
interpretation  that  RFD  staff  members  originally  indicated • 
Criterion  2:  Is  the  quality  of  the  measurement  work  that  was  done  adequate 

for  the  data  to  be  valid,  reliable,  and  objective? 

EVIDENCE 

The  external  evaluators  weren't  seriously  concerned  by 
weaknesses  in  data  handling. 

JUDGMENT 

The  measurement  work  was  valid  in  that  it  accurately 
represented  what  it  set  out  to  measure •    However,  we  question 
ics  validity  in  measuring  what  it  should  have  measured  and  its 
reliability  from  the  standpoint  of  whether  or  not  there  was 
^  ad^.quate  consistent  measurement  to  provide  e  profile  of  data 

on  the  aspects  being  examined. 

DISCUSSION 

1.    What  was  done  was  done  w^ll.    The  psychometric  staff 
applied  their  skills  with  scientific  quality.  Although 
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the data  probably  were  valid  measurements  of  what  was 
measured,  the  data  probably  aren't  valid  measurements 
of  the  program  in  that  they  neither  provided  crucial 
information  in  terms  of  how  well  the  project  met  its 
major  objectives  '  ""p  information  relevant  to  the  basic 
claims  made  for  the  program  as  an  integrated  delivery 
system. 

Although  a  good  deal  of  data  was  gathered  and  analyzed, 
very  ?-ittle  of  it  provided  two  or  three  pieces  of  evidence 
on  the  same  aspect*    There  is  difficulty  in  getting  sound 
data  either  on  results  or  reactions  in  projects  like  this; 
therefore,  consistency  of  data  secured  about  the  same 
aspect  in  two  or  more  ways  provides  an  important  check  on 
reliability. 

We  could  nit-pick  in  the  usual  way  and  point  out  several 
potential  flaws  in  the  data  handling,  such  as  very  low 
returns,  lack  of  pretest  data,  or  data  from  a  control 
r->oup  having  no  contact  with  the  program.    However,  in  regard 
to  challenging  methodology  procedures,    lost  evaluations 
or  evaluation  get  at,  and  most  researchers  are  able  to  do, 
enough  of  that  on  their  own.    We  will  reserve  our  dis- 
cussion for  aspects  of  evaluation  other  than  those  usually 
involved  in  securing  and  analyzing  data  statistically. 
Good  instruments  and  good  design  are  of  little  value  if 
they  fa^'l  to  explore  the  most  crucial  things. 
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Criteria  Drawn  From  Newer  Concepts  of  Evaluation 

One  set  of  criteria  has  been  recently  postulated  for  evaluating  evaluation. 

In  addition,  other  concepts  can  be  phrased  as  criteria  statements.    We  will 

first  examine  the  RFD  evaluation  in  terms  of  the  criteria  that  the  Phi  Delta 

Kappa  Committee  suggest  should  be  used  in  addition  to  the  traditional 

2 

scientific  criteri<u  when  evaluating  evaluation. 


Criterion  3:  is  the  evaluation  relevant?    Are  the  purposes  of  the 

evaluation  served?    Purposes  usually  include  a  list  of 
evaluative  questions  to  be  answered,  and  relevance  is  deter- 
mined by  comparing  each  evaluative  datum  to  the  purposes 
to  be  met. 

Criterion  4:  is  the  evaluation  important?    Information  must  be  culled 

to  eliminate  or  disr      jd  the  least  important  information  and 

to  highlight  the  f    :  important  information. 
Criterion  5:  I>oes  the  evaluation  have  sufficient  scope?  Information 

should  include  sufficient  scope  to  be  useful;  i.e.,  not  be 

too  narrow. 

There^s  no  indication  in  the  report  of  what  the  purpose 
of  the  evaluation  was. 

There  was  no  indication  of  relevancy.    The  purpose  of  the  ^ 
evaluation  wasn't  stated  nor  was  there  any  framework  that  in- 
dicated^how  the  specific  data  were  seen  as  addressing  evaluative 
questions  or  purpose.    Most  of  what  was  done  was  important,  but 
a  good  deal  of  important  data  wasn't  gathered.    Although  the 


2.    F.  E.  Peacock,  Phi  Delta  Kappa  National  Study  Committee  on  Evaluation. 
Educational  Evaluation  and  Decision  Making,  (1971),  pp.  "-8-30. 
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scope  was  adequate  to  secure  new  funding,  it  was  far  from 
adequate  for  serving  other  purposes  ♦ 

Discussion 

1.    One  way  of  judging  relevancy  is  whether  or  not  the  evaluation 
provided  information  germane  to  the  qualities  emphasized  in 
promotional  pieces  shared  with  professionals,  such  as 
integration  of  media,  and  uniqueness  o-^  approach:    In  our 
view  it  didn't.    Each  media  component  was  treated  separately. 
Although  the  effects  of  the  home  visiror  were  examined,  as 
additive  to  the  other  components,  no  real  test  was  made  of 
the  effects  of  aa  integrated  system.    In  fact,  no  evidence 
is  presented  that  the  system  really  was  integrated. 

It  would  have  been  useful  to  have  flow  charts  and 
examples  that  showed  whether  or  not  the  same  content  area 
reached  the  same  individual  through  all  three  major 
components  (ALMANAC j  TV,  and  home  visitor)  within  a  close 
enough  span  for  the  three  sources  to  be  integrated. 
There's  little  evidence  of  how  the  three  related  to  each 
other.    There's  no  indication  of  how  the  three  were  supposed 
to  be  integrated.    Qaestions  such  as  the  following  aren't 
answered:    Which  was  seen  as  the  main  means  of  education? 
Which  were  supporting?    How  did  fhe  others  support  the 
main  media?    If  media  shared  responsibility  equally,  how 
did  they  relate  to  each  other? 

The  evaluation  provides  no  information  on  the  central 
question  of  whether  integrated  media  are  more  effective 
than  one  medium  used  alone.    Although  it  would  have  been 
difficult,  we  feel  an  experiment  could  have  been  designed 
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to  test  for  the  effect  of  each  mediiam,  the  comparative 
effect  when  all  were  integrated  into  a  sequential  operation, 
and  the  interaction  of  the  media. 

.^lother  perspective  of  relevance  is  this:    Does  the  eval- 
uation answer  the  kinds  of  questions  most  germane  to  im- 
proving the  program?    A  set  of  evaluative  questions  was 
posed  in  the  introduction  to  the  second  year  report. 
These  questions  are  relevant  to  improving  operatlonalizing 
of  the  fundamental  concept.    As  far  as  we  can  discern, 
they  weren^t  answered. 

Since  the  program  desired  to  have  its  TV  tapes  and  other 
materials  used  by  other  adult  basic  education  programs, 
another  way  of  defining  relevancy  is  whether  or  not  it 
provided  the  information  on  eff'^ictiveness  that  other  ABE 
programs  wanted.    In  most  instances,  other  programs  would 
be  more  interested  in  the  effectiveness  of  the  TV  units  in 
producing  results  in  terms  of  specific  educational  tasks. 
The  evaluation  didn^t  deal  with  this  area. 
The  description  of  the  relevancy  criterion  implies  that  the 
purpose  and  a  selected  number  of  questions  germane  to  that 
purpose  provide  a  central  framework  for  evaluation.  Plans 
for  data  are  then  developed  so  that  it  is  very  clea^  how 
each  specific  piece  relates  to  purpose.    We  couldn^t 
identify  this  kind  of  framework  in  the  RFD  evaluation. 
It^s  our  belief  that  planning  evaluation  involves  much  more 
than  designing  research-like  experiments.    It  involves  the 
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development  of  a  flowsheet  that  relates  data  to  be  gathered 
to  the  central  data  required  in  achieving  the  purpose  of  the 
evaluation, 

5.  We  also  believe  that  the  resources  expended  on  evaluation 
are  underutilized  if  all  they  do  is  satisfy  a  funder. 
This  is  particularly  negligent  ±n  such  situations  where 

a  potential  exists  for  contributing  valuable  information 
about  programming  through  multiple  media. 

6.  Much  of  the  above  discussion  indicates  that  we  rate  this 
evaluation  low  in  terms  of  the  appropriateness  of  its  scope. 

7.  By  the  importance  criterion,  most  of  the  data  included 
was  important.    It  was  important  that  the  project  examine 
need  and  that  it  evaluate  the  pilot  tapes.    It  was  important 
that  it  get  some  information  on  TV  viewing  and  reaction. 

But  the  most  important  data  wasn't  included  in  the  evaluation 
plan. 

8.  Scope,  importance,  and  purpose  are  interrelated  and  should 
be  carefully  considered  in  the  planning  of  evaluation. 

Criterion  6:  is  the  evaluation  credible?    Those  who  are  to  use  the  infor- 

mation must  trust  the  people  who  are  providing  it. 

EVIDENCE 

WHA-TV  and  the  RFD  director  secured  funding  for  new  pro- 
jects designed  for  the  same  audience  and  using  a  multimedia 
approach • 
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JUDGMENT 

The  evaluation  was  evidently  very  credible  to  the  Office 
of  Education.    On  the  other  hand,  adult  educators  may  not  see 
a  psychometric  unit  as  a  particularly  credible  source  to  make 
an  evaluation  plan  for  a  total  program  as  complex  as  RFD. 

DISCUSSION 

1.  Some  people  stereotype  the  typical  psychometrics  unit  as 
being  expert  in  designing  tests  and  only  expert  in  that 
field.  The  RFD  experience  seems  to  bear  out  that  stereo- 
type. The  psychometrics  staff  was  extremely  credible  to 
us  in  terms  of  the  paper  and  pencil  tests  developed,  but 
they  weren't  credible  in  terms  of  the  design  (or  lack  of 
it)  of  the  total  evaluation  project. 

2.  A  comprehensive  project  like  this  needs  an  interdisciplinary 
team  that  can  utilize  not  only  the  knowledge  and  rkill 

of  educational  measurement  but  of  sociology  and  other 
social  sciences  as  well.    Ideally,  the  evaluation  should 
have  been  done  by  a  unit  made  up  of  adult  education  research- 
ers with  special  knowledge  in  evaluating  programs  for 
disadvantaged  adults.    Were  there  any  such  teams  available 
that  had  welA-establL^ihed  national  reputations?    If  not,  why? 
Criterion  7:  Was  the  evaluation  timely?    Evaluation  should  reach  the 

decision  maker  at  the  time  he  needs  it. 


EVIDENCE 

There's  no  evidence    n  thJ.s  point  other  than  the  new 
funding.    There's  no  evidence  for  example,  as  to  whether  the 
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evaluation  of  the  four  pilot  tapes  actually  was  used  in 
decisions  about  the  tapes  that  were  finally  used. 

JUDGMENT 

Timeliness  can  be  judged  only  in  terms  of  the  time  span 
related  to  purpose.    The  project  did  secure  additional  funding. 
Whether  its  results  were  unde^^stood  in  time  to  be  incorporated 
into  Project  360,  is  not  clear. 

DISCUSSION 

Two  kinds  of  timeliness  are  relevant:    (1)  the  timeliness 
of  the  evaluation  that  was  done  to  perfect  process,  and  (2) 
the  timeliness  of  the  availability  of  the  results  data. 
Criterion  8:  Was  the  evaluation  pervasive?    Did  the  information  get  to 

all  who  should  know  about  the  evaluation  and  use  the  infor- 
mation? 

EVIDENCE 

The  RFD  project  put  particular  emphasis  on  getting  infor- 
mation to  peopJ.e  in  innovative  ways. 

JUDGMENT 

This  is  probably  ^he  best  handled  part  of  the  whole  project. 

DISCUSSION 

The  final  year  report,  however,  provides  a  lesson •  It 
may  be  extremely  pervasive  in  terms  of  ge";ting  every  conceivable 
bit  of  information  to  a  reader.    It  is  1-1/2  inches  thick. 
However,  it's  not  pervasive  in  helping  the  reader  go***  key 
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information  out  of  the  report  rapidly.    In  addition it  produces 
an  image  of  acute  fragmentation. 
Criterion  9:  Was  the  evaluation  efficient?    Evaluation  should  be  efficient 

in  producing  information  that  meets  the  scientific  and  practical 
criteria  listed  earlier  with  a  minimum  drain  upon  resources 
and  a  minimum  disxniption  of  the  program. 

EVIDEUCE 

Considerable  data  were  handled  for  the  $27,000  expended, 
particularly  in  considering  that  subconcracts  were  made  to 
three  professional  research  units. 

JUDGMENT 

The  evaluation  seemed  to  b^a  efficient  in  using  its  money 
resources  even  though  they  didn't  result  in  as  great  a  value  as 
we  wovild  have  desired.    A  systems  approach  probably  would  have 
resulted  in  greater  efficiency  for  the  evaluators  and  the 
reader. 

Discussion 

1.  There's  no  indication  of  a  great  deal  of  additional  work — 
either  data  gathering  or  expert  analysis — having  been  done 
in  the  third  year,    There's  some  indication  that  more  time 
was  spent  on  new  proposal  development  than  on  making 
reflective  analysis  of  the  RFD  experience. 

2.  Anothe.   connotation  of  efficiency  that  is  getting  considerable 
attention  is  that  of  cost  comperii:.on  with  other  approaches. 
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Could  other  evaluations  have  produced  more  value 

at  the  same  cost?    In  our  judgment,  it's  very  probable 

that  they  could  have. 

In  sumnary,  then,  how  well  did  the  old  approach  to  evaluation  compare 

to  the  n-jw  criteria?    The  key  issue  involved  in  regard  to  all  of  the  practicsix 

and  prudential  criteria  is.  Did  the  evaluation  have  a  purpose?    If  so,  was 

it  the  bes-^  oossible  purpose?    In  being  consistent  with  the  plry  that  tie  RFD 

project  made  to  adult  educators  as  RFD  being  a  great  improvement  ever  the 

past  and  a  great  boon  to  adult  education,  we  believe  that  it  should  have 

incorporated  a  testing  of  its  claims  as  a  major  purpose  of  i\%  evaluation. 

RI'D  materials  cire  full  of  such  statements  as  the  following: 

"T  e  basic  premise  of  the  mediated  deliverj  system  is  that 
adults     n  be  taught  to  read,  write  and  compute  through  a  system 
that  presents  information  on  ^ow  to  cope  with  the  pressing  needs 
adults  experience  in  their  own  lives /'^ 

"The  goal  of  RFD  is  to  provide  the  undereducated  rural  adult 
the  life-cop5.ng  skills  necessary       get  out  of  the  povert^r  cycle, 

"RFD  will  also  be  reporting  in  the  coming  months  on  a  number  of 
accomplishments  that  may  lead  to  new  appro-'.ches  in  ABF  including 
the  design  of  a  broad  scope,  non-seouential  curriculum  system,  a  new 
concept  of  the  role  of  the  paraprofessional  in  ABE,  a  new  design  for 
the  training  of  paraprofessionals  and  a  new  design  system  for  loose 
leaf  content  units        As  we  move  to  the  evaluation  stage  we  will 
learn  if  we  succeeded/'  ^ 

"RFD  is  designed  to  permit  many  learners  to  deal  with  many 
problem  solving  relationships ♦    In  short,  RFD  is  a  process  that 
encourages  the  learner  to  personally  preso^ribe  his  own  curriculum 
in  order  that  he  way  become  ve  ly  for  daily  living."^ 

Yet  the  evaluation  has  not  centered  on  whether  the  project  did  i.n  fact 

carry  out  the  claims  for  it.    As  a  result  the  evaluation  isn't  as  credible, 

or  as  impressive  as  it  might  be  in  terms  of  relevance,  scope,  and  importance • 

It's  pervasive  in  that  it  is  readily  available  to  anyone  interested,  and  the 


3»  The  RFD  Project,  Op*  Cit»,  page  ZS* 

4^  Ibia^  jpage  3^ 

5*  Ibid. ,  page  !!♦ 

6«  Ibid^ ,  page  12. 
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byword  suggests  that  other  professionals  will  now  have  to  take  up  the  task 

of  "arriving  at  something  that  is  true." 

What  happens  if  we  take  some  of  the  key  concepts  from  other  contemporary 

views  of  evalxiation  and  use  them  as  criteria?    How  does  this  evaluation  rate? 

Criterion  10:    •  .    Did  the  evaluation  compress,  condense,  and  finally 

7 

accredit  that  which  is  being  evaluated? 
EVIDENCE 

The  length  of  the  internal  evaluator%  report  and 
its  lack  of  conclusions. 
JUDGMENT 

The  internal  evaluators  didn't  accept  this  criterion 

as  their  role  and  they  didn't  achieve  it,  either  by 

accident  or  by  design.    A  good  deal  more  probably  would 

have  been  acccwnplished  if  they  had  met  this  criterion. 

Criterion  11 :  Did  it  identify  "trade-offs"  and  examine  them  in 

8 

reaching  conclusions  about  programs? 
EVIDENCE 

There's  no  e-.ddence  that  trade-offs  were  considered 
and  calculated. 
JUDGMENT 

Inadequate  attention  was  given  to  evaluating  the 
most  major  trade-off  in  the  program — that  of  sxibstituting 
life-coping  skills  for  basic  computation  skills  as  the 
major  ^phasis  of  the  program — and  the  most  major  trade-off 

7.  Michael  Scriven,  Notes  from  AERA  Workshop,  Alternative  Concepts  of 
Evaluations  Portland,  Oregon  (October,  1972). 

8.  Gene  V.  Glass,  "Educational  Product  Evaluation:    A  Prototype  Format 
Applied,"  Educational  Researcher ^  I.  (January,  1972),  pp.  7-10. 
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in  the  evaluation — that  of  limiting  the  evaluation  of 
effectiveness  to  the  home  visitor  and  in  effect  saying 
that  total  integration  was  not  important. 
DISCUSSION 

Most  real-life  situations  involve  some  major  trade- 
offs.   The  decisions  involved  in  those  exchanges  usually 
affect  the  outcomes  of  the  program.    Therefore,  the  wis- 
dom of  those  decisions  often  need  to  be  considered  in 
understanding  the  effectiveness  of  a  program. 

Criterion  12:  Did  it  adequately  deal  with  the  sequence  of  inter- 

9 

related  decisions  that  made  up  prograrami"'*'' 
EVIDENCE 

Although  some  context,  process,  and  results  evaluation 
vere  done,  there's  no  indication  that  an  attempt  Wcis  made 
to  interrelate  the  three.    No  evidence  of  input  evaluation 
exists.    On  the  other  hand,  there's  evidence  that  decisions 
made  as  a  result  of  context  evaluation  (card-sorting  of 
interests  and  needs)  weren't  considered  in  the  results 
evaluation.    Although  fourteen  key  areas  were  identified 
in  need  assessment,  this  list  doesn't  appear  very  related 
to  the  areas  used  by  the  psychometrics  lab. 
JUDGMENT 

The  evaluation  didn't  appear  to  deal  adequately  with 
interrelatedness  of  program  decisions.    As  a  result  it  did 
not  adapt  to  the  changed  focus  of  the  program. 

9.    Phi  Delta  Kappa  National  Study  Committee  on  Evaluation,  Op.  Cit., 
pp.  79-8«f;  215-238. 


A  project  that  purports  to  be  based  on  needs  should 
use  those  needs  as  a  basis  for  evaluation. 
The  needs  study  seemed  to  be  ftsed  primarily  for 
switching  from  basic  communication  and  computation 
skills  to  a  smorgasbord  of  interesting  areas.  That 
decision  had  some  major  consequences  in  the  results 
of  the  program. 

a.  It  made  the  project  less  useable  to  traditional 
ABE- 

b.  It  destroyed  the  uniqueness  of  the  program.  Home 
Economics  Extension  had  for  some  time  been  using 
all  of  the  media  used  in  RFD  in  family  oriented 
programs.    There's  no  evidence  that  RFD  did  a 
better  job  in  integrating  those  media  than  does 
the  county  Extension  home  economist. 

An  essential  element  in  program  evaluation  is  the 
evaluation    of  the  consistency  of  decisions.  Evalu- 
ating input  decisions  is  an  important  element  in  en- 
suring that  the  project  will  accomplish  what  it  sets 
out  to  accomplish.    There's  no  evidence  this  kind  of 
evaluation  was  done.    It  could  have  evaluated  the  de- 
gree of  integration  that  was  planned,  and  determined 
whether  sufficient  concantration  was  being  given  to 
any  particular  coping  area  foi*  there  to  be  some 
hope  for  sizeable  gain. 

Process  evaluation  should  give  considerable  attention 
to  whether  or  not  the  planned  input  and  integration 
actually  is  occurring.    It  keeps  things  on  track.  This 
type  of  evaluation  didn't  appear  to  be  done  in  this 
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project.    Various  processes  were  examined  but  the  effec- 
tiveness of  process  in  carrying  out  planning  decisions 
seems  to  have  been  ignored. 
Criterion  13:  Did  it  improve  decision  making? 

EVIDENCE 

There's  little  evidence  the  RFD  evciluation  was  de- 
signed for  this  purpose.    There's  some  evidence  that  find- 
ings did  result  in  certain  decisions,  but  little  evidence 
as  to  whether  the  evaluation  was  adequately  designed  to 
deal  with  the  decisions  in  which  they  were  used. 
JUDGMENT 

The  RFD  evaluation  may  have  resulted  in  faulty  de- 
cisions rather  than  improving  decision  making.    If  the 
decision  situation  had  been  adequately  analyzed  in  ad- 
vance, the  evaluation  may  have  been  more  useful. 
DISCUSSION 

In  the  three  instances  where  evaluation  appeared  to 
trigger  decision — first,  the  switch  ft»om  the  basic  skills 
to  coping  skills;  second,  the  switch  of  the  role  of  TV 
from  education  to  motivation;  and  third,  the  use  of  the 
TV  news  format — the  evidence  provided  in  the  evaluation 
doesn't  seem  to  be  sound  enough  to  support  the  decision 
that  was  made  and  there  is  insufficient  material  to  up- 
hold the  decisions  in  the  results  evaluation • 

Criteria  We  Were  Using  in  Our  Instant 
Judgment  of  the  RFD  Evaluation 

It's  hard  to  know  where  the  last  section  stops  and  this  one  begins. 


-  24  « 

Certainly  our  thinking  about  evaluation  has  been  colored  by  our  acceptance 
of  many  of  the  ideas  advanced  in  the  past  few  years.    Since  we  believe  t'lat 
evaluation  includes  judgments ,  one  important  criterion  deals  with  the  quality 
of  those  judgments. 

Criterion  14:  Were  the  judgments  accurate  and  well-founded? 

EVIDENCE 

The  internal  evaluation  provided  evidence  but  no 
judgment.    The  external  evaluation  provided  judgment  but 
no  evidence. 
JUDGMENT 

The  internal  evaluators  made  no  judgments.    The  work 
of  the  external  evaluators  was  entirely  that  of  making 
judgments.    At  times,  there  appeared  to  be  inadequate 
evidence  to  support  the  judgment  made.    Although  they  made  . 
some  effort  to  define  objectives  in  terms  of  criteria, 
greater  refinement  was  needed. 
The  next  two  criteria  provided  different  approaches  to  key  judgments 
that  were  made  earlier. 

Criterion  15:  Did  the  evaluation  deal  with  the  most  important  questions? 

EVIDENCE 

The  evaluation  dealt  with  few  specific  questions. 
JUDGMENT 

No,  it  did  not  deal  with  the  aspect  of  an  integrated 
delivery  system.    It  did  not  test  the  claims  made  for  the 
program.    It  did  not  examine  the  results  in  terms  of  need, 
either  as  generally  expressed  or  in  terms  of  whether  the 
clientele  felt  that  it  met  their  needs.    The  internal 
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evaluation  dia  not  deal  with  cost  comparisons.  The 
external  evaluation  made  some  attempt  to,  but  did  not, 
integrate  the  discussion  sufficiently  with  the  rest  of 
the  evaluation. 
Criterion  16:  Was  the  evaluation  useful? 

EVIDENCE 

There's  very  little  evidence  that  the  evaluation  was 
very  useful  to  the  program  or  to  those  who  will  be  trying 
to  learn  about  programming  from  the  experiences  of  the 
program. 
JUDGMENT 

We  didn't  find  the  RFD  evaluation  particularly  useful* 
DISCUSSION 

1.  Use,  like  beauty,  is  in  the  eye  of  the  beholder.  Evalu- 
ation can  be  useful  in  a  variety  of  ways.    We  feel 
evaluation  is  most  useful  when  it  helps  improve  pre- 
sent and  future  programs.    The  RFD  evaluation  didn't 
seem  either  to    improve  the  RFD  program  as  it  was 
being  implemented  or  to  give  us  many  ideas  about  how 
adult  education  can  be  improved  in  the  future. 

2.  Another  concept  of  use  is  the  extent  to  which  evalu- 
ation is  useful  in  managing  the  programming  operation. 
There's  little  indication  that  it  played  this  role. 

3.  Evaluation  isn't  something  to  be  done  because  someone 
requires  it  or  because  curriculum  courses  teach  it  as 
the  final  step.    It's  something  to  be  done  when  and 

if  the  value  provided  by  it  is  greater  than  the  resources 
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invested  in  it;  i.e»,  whether  its  utsefulness  exceeds 
its  costs ♦ 

A  quite  different  kind  of  criteria  that  we've  been  proposing  for  programs 
and  that  we  should  try  out  in  this  instance  is  as  follows: 

Criteribn  17:  Does  the  evaluation  compare  well  with  other  evaluations? 

EVIDENCE 

Study  of  several  other  evaluations  carried  out 
during  the  same  period  of  time* 
JUDGMENT 

^  The  RFD  evaluation  did  fully  as  well,  or  better  than  most  other 

evaluations  that  have  operationalized  the  basic  concept 
of  evaluation  prevalent  in  the  1950s  and  1960s. 
DISCUSSION 

1.  It's  one  thing  to  compare  performance  to  an  ideal 
.standard.    It's  another  to  compare  it  with  "track 
records"  built  up  in  similar  situations.    How  does  that 
which  is  being  evaluated  compare  with  the  best  that 
has  gone  before  it?    Or  with  the  average  of  the  kinds 
of  performance  that  has  gone  before  it?    We  find  the 
RFD  evaluation  is  very  typical  of  evaluations  that 
operationalize  the  concept  of  evaluation  holding  the 
stage  during  the  early  1960s.    Unfortunately,  too  few 
evaluations  have  as  yet  been  carried  out  using  ideas 
from  the  1970s  so  that  there  is  a  basis  of  comparison. 

2.  Could  we  have  done  better?    Probably  not.    It's  no  easy 
matter  dealing  with  the  complexities  of  a  dynamic  in- 
novative program  that  has  outside  requirements  and 
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many  opportunities  and  needs  for  evaluation.  We 
might  have  done  better  in  some  areas  and  worse  on 
others.    We  certainly  couldn't  have  done  better  in  1969, 
because  our  understanding  of  evaluation  hadn't  pro- 
gressed any  farther  at  that  time  than  had    the  under- 
standings of  those  people  who  carried  out  the  RFD 
evaluation. 

Forming  an  Overall  Judgment 

The  evaluation  was  examined  in  terms  of  seventeen  criteria.    It  rated 
very  well  on  some,  such  as  criterion  number  8,    It  rated  moderately  well  on 
some  and  poorly  on  others.    What  overall  judgment  would  one  make?    Should  the 
seventeen  criteria  be  equally  scored  and  a  composite  score  built?    Or  are 
some  more  important  than  others? 

The  criteria  were  of  different  types.    Some  dealt  with  the  quality  of 
the  work;  others  with  what  the  work  contributed  that  was  of  value.    We  be-- 
lieve  that  the  most  important  criteria  are  those  dealing  with  the  contri- 
bution of  the  evaluation — criterion  statements  3,       13,  l^j  and  15.  An 
evaluation  that  does  not  atack  up  well  in  terms  of  relevance,  iinportance, 
usefulness,  and  contribution  to  key  questions,  is  not  of  much  value  regard- 
less of  how  well  it  was  done.    In  our  judgment,  the  RFD  evaluation  failed 
because  it  didn't  address  itself  to  an  important  enough  purpose.    The  pro- 
gram and  the  field  of  adult  education  were  shortchanged  because  evaluation 
was  limited  to  providing  results  data  to  a  funder. 

Conclusions  and  Implications 

Although  the  RFD  evaluation  adequately  carried  out  its  approach  to  evalu- 
ation fairly  well,  the  approach  itself  is  inadequate. 

Ideas  such  as  the  following  must  be  added  to  both  the  theoretical  construct 


and  the  real-life  beliefs  about  evaluation  before  a  measurement  approach 


to  evaluation  will  reach  its  optimum  value. 

1.  Program  evaluation  must  be  useful.  It  must  be  present-  and  future- 
oriented.  It  should  cover  several  uses.  To  the  extent  possible,  it  should 
do  the  following: 

a.  It  should  be  useful  in  the  operation  and  improvement  of  the 
program. 

b.  It  should  be  useful  to  the  participants  and  to  the  programmers 
as  well  as>  or  instead  of,  outsiders. 

c.  In  situations  where  programs  purport  to  be  making  major  contri- 
butions to  the  understanding  of  processes  of  adult  education, 
as  RFD  did,  it  should  be  of  use  to  other  educators. 

2.  ProgroF:  evaluation  should  adStress  itself  to  fundamental  questions 
of  acQomplishment  and  value.    In  addition  to  examining  whether  specific 
objectives  are  attained,  program  evaluation  should  also  endeavor  to  examine 
more  basic  questions  such  as  the  following: 

a.  Was  the  need  that  originated  the  program  actually  satisfied? 

(1)  If  the  prograir*  was  addressed  to  a  problem,  what 
happened  to  that  problem? 

(2)  If  the  program  was  built  t6  meet  needs  c  dividuals, 
were  those  individuals  satisfied  that  thexx  needs  had 
been  met? 

b.  Were  the  major  claims  made  for  the  program  adequately  examined 
and  tested? 

c.  Was  the  program  as  effective  and  efficient  a  means  of  meeting 
the  need  or  purpose  as  could  be  devised  at  the  present  time? 
How  did  it  compare  with  other  ways  of  doing  the  same  thing? 

d.  Were  there  any  major  harms  or  benefits  associated  with  the 
program? 

e.  Did  it  produce  enough  of  value  to  be  worth  its  cost? 

w.    Progr-am  evaluation  is  a  system  and  should  he  treated  as  such. 

a.    In  program  evaluation  our  concern  is  primarily  with  the  effect 
of  the  program  components  in  producing  results.    Although  in  a 
research  style  approach  the  program  components  are  usually 
thought  of  as  independent  variables  and  the  results  as  the  de- 
pendent variables,  we  are  concerned  in  what  the  results  tell 
us  about  the  independent  variables  rather  than  in  how  the  in- 
dependent variables  explain  the  results.    An  evaluati^on  that 
does  not  go  beyond  the  results  and  relate  those  results  to 
the  program  falls  short  of  its  responsibility  as  program  evalu- 
ation. 
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b.    Program  evaluation  involves  a  series  of  interrelated  decisions 
and  activities  in  the  same  way  that  a  program  does.  Reports 
of  evaluation  should  make  the  nature  and  sequence  of  these 
decisions  and  activities  clear.    This  involves  much  more  than 
simply  presenting  the  decisions  involved  in  setting  up  an  ex- 
perimental design. 

^.    Program  evaluation  must  be  able  to  compress^  condense,  and  accurately 
interpret  data  in  relation   to  the  purposes  of  the  evaluation.    It's  not 
enough  just  to  provide  data. 

a.  Adequate  attention  must  be  given  to  criteria  and  to  judgment 
as  well  as  to  the  handling  of  evidence. 

b.  Evidence  and  criteria  should  be  clearly  organized  in  terms  of 
the  judgments  that  are  to  be  made.    The  judgments  are  determined 
by  the  pxarpose  of  the  evaluation.    Usually,  the  purpose  can 

be  translated  into  a  set  of  questions  that  must  be  answered 
or  decisions  that  must  be  made.    Judgments,  criteria,  and  ev- 
idence' should  be  tested  against,  and  organized  under  those 
questions  and/or  decisions  to  ensure  that  the  evaluation  has 
sufficient  relevance,  scope,  and  importance. 

c.  Programs  may  be  evaluated  on  several  characteristics.  Part 
of  compression  and  condensation  involves  a  weighting  of  the 
relative  importance  of  those  judgments ♦    Are  they  equal?  Or 
are  some  more  crucial  than  others? 

c.    Those  activities  which  stop  with  the  provision  of  data  are 
activities  of  program  description  rather  than  program  evalu- 
ation.   Program  evaluation  must  also  incorporate  those  activ- 
ities which  assign  value  to  the  informaiton. 

Analyzing  evaluation  that  has  been  done  in  terms  of  its  value  and  use 
instead  of,  or  in  addition  to, the  proficiency  of  its  research  methodology 
can  contribute  a  good  deal  to  our  understanding  of  evaluation.  However, 
to  evaluate  evaluation  one  needs  to  establish  the  kinds  of  judgments  that 
need  to  be  made  and  the  kinds  of  criteria  that  need  to  be  used.    We  have 
identified  and  used  a  few  criteria.    They  express  what  we  see  as  being  val- 
uable in  an  evaluation.    They  are  open  to  a  good  deal  of  argument.  Most 
criteria  are  subject  to  Ciiiilonge  just  as  most  judgments  are.  Evaluation 
can  be  viewed  as  the  means  of  establishing  the  parameters  and  guidelines 
for  debating  worth.    This  concept  is  a  far  cry  fr»om  the  traditional  concept 


of  establishing  scientifically  pure  proof  that  results  have  boen  attained. 
But  scientifically  processed  information  is  not  useable  unless  one  is  able 
to  debate  and  defend  the  values  involved  in  using  it. 

Unfortunately,  this  is  a  first  attempt  at  evaluating  evaluation.  We 
have  not  explored  the  criteria  that  should  be  applied  to  evaluation  suffic- 
iently to  be  willing  to  argue  that  these  are  the  only  crite-ria  or  that 
these  are  the  roost  important  ones.    However,  we  do  maintain  that  the  tra- 
ditional ones  are  inadequate.    Ke  haven't  really  dealt  with  whether  the 
kinds  of  judgments  we  made  are  the  most  crucial  ones.    We've  made  several 
that  seem  valuable  to  us  at  this  point  in  time.    How  valuable  are  they — 
and  the  criteria  we've  used — to  you?    Why  are  they  or  aren't  they  valuable? 
What  do  you  believe  constitutes  good  evaluation?    How  do  you  -jvaluate  evalu- 
ation?   We  think  we've  given  you  some  things  to  debate.    We  hope  we've 
given  you  some  things  to  think  about. 
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Introduction 

Nev;  and  innovative  social  action  programs  necessitate 
the  development  of  valid  and  reliable  instruments  in  order  to 
assess  program  effectiveness.    The  Expanded  Nutrition  Educatio. 
Program  (ENEP)  which  employs  low  income  v;omen  (Cooperative 
Extension  Aides)  to  teach  a  nutrition  education  program  to 
indigent  clientele,  was  one  such  protjram  v;hich  requ:'.red  instru- 
ments to  assess  the  effectiveness  of  aides  in  helpino-  clientele 
to  attain  program  objectives. 

Reported  xn  this  paper  is  the  development  and  use  of 
three  instruments  capable  of  making  assessments  of  aides  in 
three  areas:    knowledge  of  teaching-learning  principles  and 
strategies  in  teaching  families  and  youth,  job  persistence, 
and  attitude  tov/ard  the  human  service  job  of  being  an  aide* 

The  research  reported  here  was  part  of  an  ongoing  evalu- 
ation research  project  being  conductv^d  by  Dr.  Helen  Y.  Nelson 
and  Mrs.  Bettie  Lee  Yerka,  Department  of  Community  Service 
Education  and  Cooperative  Extension,  Home  Economics,  New  York 
State  College  of  Human  Ecology,  Cornell  University.    In  1969 
Nelson  and  Yerka  initiated  an  exploratory  research  project 
designed  to  evaluate  the  effectiveness  of  aides  working  with 
low  income  families  in  Hew  York  State. 

pbj  ec  tiyes^  of  The  Study 

The  objectives  for  this  study  v/ere  as  follows: 

1.    To  construct,  refine,  and  validate  instruments  which 
are  capable  of  measuring  progress  of  paraprofessionals: 

a)  in  knowledcje  and  skill  in  v/orking  with  low 
income  families  in  a  teaching  situation; 
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b)  relating  to  attitudes  toward  the  job  as  an  aide; 

c)  as  to  job  persistence  in  becoming  more  employable 
and/ or  remaining  employed  as  an  aide. 

2.  To  determine  the  reliability  and  item  discrimination 
of  these  instruments. 

3.  To  validate  the  three  instruments  v/ith  the  criterion 
measure,  based  on  the  Extension  Service,  USDA,  food  recall. 

4.  To  determine  v;hat  characteristics  of  aides  affect 
the  quality  of  instruments  and  the  criterion  measure. 

Description  pf  ^the  Sample 

Extension  home  economists  (agents)  and  Cooperative 
Extension  Aides  employed  in  fifteen  counties  and  one  site  (Q) 
located  in  a  large  metropolitan  city  in  ffew  York  State  partici- 
pated in  one  or  more  phases  of  the  study.    All  of  the  partici- 
pating units  v;ere  suggested  by  State  Extension  ENEP  Adminis- 
tration; participation  was  on  a  voluntary  basis. 

The  main  sample  of  counties  consisted  of  eight  counties 
who  were  involved  in  all  aspects  of  the.  study.    Eight  additional 
counties  or  site    were  involved  in  one  or  more  aspects  of  the 
study.     In  summary,  three  urban  counties,  one  urban  site,  eight 
urban-rual  counties,  and  four  rural  counties  were  involved  in 
one  or  more  aspects  of  the  study.    Twelve  of  the  counties  have 
been  involved  in  the  ENEP  since  1969;  four  entered  the  program 


Data  Re_cicirdinc|_  the_  Aides 

Demographic  data,  describing  the  rjopulation  of  aides  in 
the  eight  county  main  sample  were  obtained  from  emploionent 
application  forms  completed  by  the  103  aides  v7hen  applying  for 
the  job.    Information  regarding  length  of  time  the  aides  had 
been  employed,  dates  of  employment  and  resignation,  and  employ- 
ment on  a  part-time  or  full-time  basis  was  checked  using  payroll 
and  other  records  housed  by  Extension  ENEP  Administration  at 
Cornell  University. 

During  the  period  of  the  study  (March,  1969  -  June,  1971) 
fifteen  per  cent  of  the  aides  had  been  employed  twelve  months  or 
less,  forty  per  cent  had  been  employed  from  thirteen  through 
twenty-four  months,  and  forty-five  per  cent  had  been  emploved 
oyer  twenty-four  months.    The  highest  percentage  of  the  aides 
(47  per  cent)  were  from  30  to  44  years  of  age,  39  per  cent  v;ere 
over  44  years  of  age,  and  14  per  cent  were  under  30  years  of 
age.    Approximately  one  half  of  the  aides  (55  per  cent)  were 
married,  v/ith  the  remainder  being  separated  (18  per  cent)  , 
divorced  (14  per  cent),  or  v;idov/ed  (11  per  cent).    Two  aides 
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were  single*    Forty-five  per  cent  of  the  I'omen  were  heads  of 
one--parent  households  and  as  such  undoubtedly  have  the  responsi- 
bility for  financial  support  of  themi:elves  and  their  families. 

The  number  of  children  ranoed  from  none  to  ten,  v;ith  the 
mean  number  3.12  and  the  median  2.91.     Sixty  aides  had  three 
or  more  children.    Most  of  the  children  v/ere  school  age  (S  to 
18  years)  v;ith  out  of  school  (19  and  over)  ne::t.    There  v/ere 
fewer  preschool  children • 

The  educational  attainment  of  the  aides  fell  into  three 
major  categories,     training  beyond  high  school  (30  per  cent), 
completed  high  school  or  high  school  equivalency  (2G  per  cent), 
and  more  than  eighth  grade  but  less  than  high  school  (23  per 
cent) . 

Most  of  the  aides  (57  per  cent)  in  the  study  v/orked  v;ith 
adults  only:  tv;enty- three  per  cent  \/orked  v;ith  both  adults  and 
youth;  six  per  cent  v/orked  with  youth  only  and  eleven  per  cent 
v;ere  supervisory  aides.  Sixty-one  aides  v/orked  on  a  full-time 
basis  (35  hours  or  more)  and  forty- two  aides  v/orked  part-time 
(less  than  30  hours  a  v/eek). 

Seventy^-nine  of  the  aides  were  classified  as  being  em- 
ployed by  the  end  of  June,  1971;  with  tv/enty-four  aides  leaving 
employment  during  the  study  period.    Almost  all  of  the  aides 
had  been  previously  employed  before  being  hired  as  Cooperative 
Extension  Aides.    About  half  had  held  one  to  two  previous  jobs 
and  thirty-six  per  cent  had  held  from  three  to  five  jobs. 
Four  aides  reported  not  having  been  previously  employed. 

Deyelppment  of ^  the  Ins  truments 

The  rationale  for  the  focus  of  each  particular  instrument 
v/as  as  follov/s; 

1.  In terviev/- Achievement  Test  of  Teaching-Learning 
Principles:     Since  the  aide  serves  in  a  teaching  role,  she 
should  have  a  knowledge  of  teaching-learning  principles  and 
strategies,  and  their  application  as  a  means  of  achieving  the 
goals  of  the  program.    Ascertaining  the  extent  of  the  aide-s 
knowledge  about  teaching- learning  principles  and  their 
application  v/ould  be  beneficial  in  determing  v/hat  content 
regarding  the  teaching-learning  process  should  be  incorporated 
into  in-service  training  of  the  aides • 

2.  Job  Persistence  Form:     Since  the  program  employed 
low  income  persons,  part  of  the  job  experience  could  be  con- 
sidered as  providing  the  aides  v/ith  the  opportunity  to  either 
learn  behaviors  that  v/ould  cause  them  to  be  more  valuable  to 
the  program  or  that  v/ould  enhance  their  future  employability 
in  another  position.     It  v/as  thought  that  the  aides,  coming 
from  lov/  income  populations,  v/ould  need  assistance  in  gaining 
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skills  that  would  enhance  or  improve  their  employability. 

3.    Attitude  Scale:     Because  attitudes  can  influence 
behavior,  knov/ledge  about  hov;  the  aides  feel  to\;ard  their  jobs 
could  provide  helpful  feedback  to  professional  and  supervisory 
staff. 

Considerations  in  selecting  the  kinds  of  instruments  and 
procedures  for  collecting  the  data  v/ere  influenced  by  the 
f  ollov/ing: 

1.  It  v;as  felt  that  the  aides  should  not  have  many 
additional  records,  forms,  etc.  to  complete  as  they  v/ere  already 
responsible  for  a  number  of  records  and  reports  as  a  routine 
part  of  their  job. 

2.  There  was  concern  at  the  beginning  of  the  project 
that  the  aides  might  have  limited  reading  and  v/riting  abilities, 
since  they  v;ere  recruited  from  low  income  populations.  Hence 
instruments  would  need  to  be  developed  that  would  be  v/ithin  the 
v;ri ting  aid  reading  capabilities  of  the  aides.     It  was  also  felt 
that  the  aides  were  more  facile  verbally  than  in  writing,  v/hich 
suggested  that  the  interviev;  procedure  would  be  a  feasible  way 
to  ascertain  the  aide's  knowledge  of  teaching-learning  princi- 
ples, rather  than  a  paper  and  pencil  test.    Word  (1958)  found 
than  an  open-ended  interview  procedure,  using  a  tape  recorder, 
was  a  satisfactory  procedure  in  obtaining  data  from  aides  in  an 
Arkansas  project o 

3.  Data  would  be  obtained  in  several  ways,  on  different 
aspects  of  the  aides,  from  both  aides  and  supervisory  personnel. - 

4.  It  was  desirable  that  the  instruments  be  easy  to  score 
and  not  require  time-consuming  procedures  to  arrive  at  a  score 
for  each  aide. 

Interyiew;-^^^^  Test^  of  Teach±ngrLedirn±ng^  Principles 

As  stated  earlier,  the  purpose  of  this  instrument  v;as 
to  assess  the  aide's  knowledge  and  understanding  of  teaching- 
learning  principles  and  strategies  as  applied  to  her  v;ork  v;ith 
individuals  and  groups.    After  observations  were  made  of  the 
initial  in-service  traxiiing  programs  in  five  counties  in  Spring, 
1969,  work  began  on  the  Development  of  the  interview  schedule. 

For  content  validity,  an  underlying  grid  of  teaching- 
learning  principles  was  developed,  based  upon  a  literature 
review  in  the  field  of  adult  learning,  job  training,  home 
economics  education,  and  training  materials  used  in  ENEP*  Two 
faculty  members  in  adult  education  and  one  member  in  the  Depart- 
ment of  Educational  Psychology  at  Cornell  Univerity  v/ere  con- 
sulted as  to  the  appropriateness  of  the  content  of 'the  grid. 
Revisions  v/ere  made  to  the  grid  based  upon  the  suggestions  of 
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these  experts • 

The  development  of  a  standardised  interview;  schedule 
v/hich  focused  on  the  aide's  Icnowledce  of  teaching-learninc; 
principles  progressed  frora  an  open-ended  form  to  a  more 
structured  schedule  v/ith  checklists  of  possible  responses 
and  a  scoring  system  for  each  teachincj^-learning  principle. 
(See  Appendix  A  for  sample  questions.)    The  procedure  was 
similar  to  the  one  suggested  by  Lasarsfeld,  as  reported  by 
Selltiz,  et  al*,  for  developing  a  closed^-question  interview* 
Lazarsfeld  suggested 

that  the  development  of  a  closed-question  interview 
schedule  be  preceded  by  more  intensive,  freer  inter- 
views v;ith  a  subsample  of  the  population  in  order  to 
discover  the  range  of  probable  responses,  the  dimen-- 
sions  that  are  seen  as  relevant,  and  the  various 
interpretations  that  may  be  made  of  the  question 
wording  (1959:262). 

Early  versions  of  the  interviev/  schedule  indicated 
that  v/hile  the  aides  talked  freely  about  their  v/ork,  their 
global  responses  v;ere  difficult  to  categorize  to  reveal 
knowledge  of  teaching-learning  principles o     In  part  the 
early  versions  of  the  interview  schedule  helped  the  v^riter 
to  become  familiar  with  the  aides"  language,  terminology, 
their  procedures  in  planning  lessons  and  approaches  in  v/orking 
with  clientele  and  to  determine  their  reactions  to  the  questions. 

The  first  major  pretest  v;as  made  v;ith  fourteen  aides 
in  one  county.    It  vras  found  upon  analysis  that  most  of  the 
aides  gave  approximately  the  same  type  of  response  to  the 
questions  and  that  the  responses  focused  more  on  food  prepa- 
ration and  nutrition  practices  than  on  knowledge,  understanding, 
and  application  of  teaching-^learning  principles.     The  open- 
ended  responses  did  not  permit  ready  categorization  for  a 
scoring  system. 

The  second  pretest  version  included  a  checklist  of 
possible  responses  and  a  three  point  scoring  system  for  most 
questions*    The  scoring  system  enabled  the  interviewer  to  mark 
a  score  for  the  question  based  upon  the  response  given  by  the 
aide.     Space  v;as  provided  for  the  interviev/er  to  write  in 
additional  comments,  if  needed  to  substantiate  the  score  given. 
Difficulties  arose  in  scoring  this  version  becasue  the  decision 
to  determine  if  the  aide  knew  the  teaching-learning  principle 
had  to  be  inferred  from  the  aide's  application-type  response. 

The  interview  schedule  was  revamped  again,  to  focus  more 
on  teaching-learning  concepts.     Early  versions  of  the  interview 
schedule  obtained  information  as  to  what  the  aides  did  in 
teaching  families  but  did  not  directly  pinpoint  the  aide's 
knowledge  of  teaching-learning.     Inferences  had  to  be  made  from 
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her  practice-oriented  responses. 

The  final  question  format  which  evolved  v/as  one  of  asking 
the  aide  a  cluster  of  two  or  three  questions  about  the  particu- 
lar principle  involved  as  f  ollov/s  > 

1)  the  aide  \;as  asked  if  she  did  a  particular  procedure 
or  not J 

2)  v/hy  she  did  it  (a  knowledge  question),  and 

3)  what  or  hov/  she  did  it  (an  application  question)  * 

The  three-point  scoring  system  for  each  question  or 
cluster  of  questions  included  the  principle  involved.  More 
probes  were  added  (each  question  had  one  probe  question)  and 
the  checklist  of  possible  answers  was  expanded  to  include  a 
range  of  relevant  responses •     The  sequence  of  the  questions  v;as 
arranged  so  the  interview  would  be  in  the  most  logical  order  for 
the  aides  to  respond  to — going  from  the  first  contacts  the  aide 
made  with  the  family,  gaining  the  confidence  of  the  homemaker, 
finding  out  the  need',  and  prior  experience  and  knov/ledge  of  the 
homemaker,  planning  the  lesson  and  teaching,  and  ending  with 
evaluation. 

The  following  example  illustrates  the  changing  format  of 
a  question  from  Pretest  1,  Pretest  2,  to  the  final  version. 
The  aides  are  being  asked  about  the  principle  of  informing  the 
homemaker  about  the  progress  she  is  making  in  learning  the 
lesson  content. 

Pre test  1 : 

Do  you  let  the  homemaker  knov/  v;hen  she  has  done  something 
v;ell?    Uhat  do  you  do?    Could  you  give  me  an  example? 

Pretest^  2 . 

As  you  ivork  with  a  homemaker  how  do  you  let  her  know 
that  you  are  happy  with  hov/  she  is  coming  along'^ 
(Probe-     Are  there  any  other  v/ays'"-')     (Check  appropriate 
responses  if  aide  mentions); 

_     _lo    Aide  praises  homemaker 's  efforts 

2.  ;\ide  tells  homemaker  abouh  her  progress 

3.  Aide  tries  very  hard  for  homemaker  not  to 
have  a  failure 

4.  Other  (describe) 
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(3)   Recognises  that  for  learning  the  homemaker 

needs  to  knov;  about  her  progress  (2  v/ays  men- 
tioned) 

(2)  _     ,  Some  recognition 

(1)  _  .  .  *  Little,  if  any,  recocnition 

Final  Interview:  ;'.-30 

Do  you  let  the  homemaJcer  know  ho\/  she  is  coming  along 
v;ith  what  you  are  telling  (or  teachinc)  her  about  food 
and  nutrition; 

 yes   no 

VJhy  do  you  lefc  the  homemaker  kno\/  how  she  is  coming 
along?     (Probe:    Are  there  any  other  reasons  why  it  helps 
a  homemaker  to  knov/  how  she  is  doing?) 

 1»     The  hoh^emaker  v/ill  be  encouraged  to  continue 

with  the  program  if  she  knows  she  is  learning 

 2.     The  horaemaker  v;ill  learn  better  v/hen  she  knows 

about  the  progress  she  is  making 

 3»     Other  _  ,  

In  v/hat  ways  do  you  let  the  homemalcer  know  hov;  she  is 
doing  or  coming  along? 

 1.     By  telling  her  what  progress  she  is  making 

\  \  _  \  2.     By  praisinc,  her 

 3,     By  aslcing  her  if  sl^e  saved  any  laoney  or  if  her 

family  v/as  pleased  v/ith  \;hat  she  did 
 A.  Other   

Score:     (3)   Aide  realises  that  learning  is  more 

effective  v;hen  the  homemaker  knov/s  how 
she  is  coming  along 

(2)    Some  recognition  on  the  part  of  the  aide 

......  Aide  has  little,  if  any,  recognition 

that  the  homemaker  needs  to  knov/  about 
her  progress 

For  the  firml  interview  used  in  upstate  New  York,  twenty- 
four  scoreable  questions  v/ere  developed  plus  five  *'ice--breaker'' 
questions  designed  to  obtain  some  j:)ackground  information  from 
the  aide,  to  put  her  at  ease,  and  to  re-emphasize  that  she 
v/ould  be  tallying  about  her  job. 

D  a  t    Cp  l  l  e  c  t  i  o  n 

Eighty-nine  usable  interviews  were  obtained  after  ^ 
interviewing  ninety  aides  in  the  eight  county-imain  sample. 
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One  interviev/  could  not  be  used  because  of  language  problems . 
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The  interviev/ing  vjats  done  from  I  larch  -  May,  1970  ::y  the  writer 
and  other  persons  associated  with  the  Evaluation  Research  Project. 
Arrangements  v/ere  made  v;ith  the  County  Extension  Agents  for  the 
scheduling  of  the  interviews  in  the  counties.    The  interviews 
v/ere  conducted  during  the  day  and  \;ere  considered  a  part  of  the 
v;ork  tirae  for  v/hich  the  aides  were  paid.     Interviewing  i;as 
usually  done  at  the  Extension  headqucrterc  or  at  another  meeting 
f)lace  used  by  the  county  Cooperative  Extension  organi?:ation. 
The  interviews  lasted  from  an  hour  to  an  hour  and  a  half,  de- 
pending on  hov;  taZ Motive  the  aides  were. 

The  aides  V7ere  told  by  t'.ie  intervie\7ers  tl^at  the  inforr- 
mation  \;ould'  oe  confidential .  cnr'  v/ould  in  no  v/ay  affect  their  ^ 
jobs.    A  majority  of  the  interviev/s  were  taped.    To  names  of 
the  aides  were  included  on  the  tapes «     The  aides  did  not  seem 
to  be  adversely  affected  by  the  use  of  the  tape  recorder. 

Coraments  from  several  Extension  agents,  with  one  excep- 
tion, indicated  that  the  aides  did  not  seem  to  be  unduly  both- 
ered by  the  interview  situation.    A  fe\/  agents  reported  that 
the  aides  felt  the  ''interview  vjas  long*'  and  "a  lot  of  work.'* 
Some  of  the  aides  found  the  questions  hard  to  ansv/er  and  mode 
them  do  a  -lot  of  thinking.'*    Even  though  a  concerted  effort 
had  been  made  to  use  as  little  educational  jargon  as  possible, 
a  fev/  agentc  did  question  v/hether  the  terminology  used  affected 
the  response a 

Refined  Interview  Schedule 

The  interview  schedule  v;as  later  refined  for  use  in  a 
research  project  at  Site  Q  in  January,.  1971.    The  refinement  of 
this  interviev;  schedule  v;as  based  upon  analysis  of  the  data 
gained  from  the  eighty-nine  interviev/s.     As  a  result  of  sepa- 
rating clusters, of  questions  and  adding  two  new  questions  (and 
revising  or  altering  the  cliecklists  of  responses  based  upon  the 
summary  of  responses  from  the  upstate  sample  of  aides),  an 
interview  schedule  containing  thirty--nine  scoreable  items  was 
prepared.     Tv;enty-six  aides  (primarily  at  Site  Q)  v/ere  inter^-^ 
viewed  with  this  schedule  from  January  -  June,  1971. 

Job  Persistence  Form 

The  purpose  of  this  form  v;as  to  provide  a  way  for  super- 
visory personnel  (Extension  agents  and  supervisory  aides)  to 
observe,  record,  and  rate  behaviors  by  which  an  aide  indicates 
her  desire  and  intention  to  either  remain  employed  or  to  become 
more  employable.     This  instrument  was  not  intended  to  provide  a 
one- 'time  performance  rating,  but  rather  a  synthesis  of  the 
supervisor's  observations  of  the  aide  as  they  worked  together 
over  a  period  of  time. 
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This  instrument  v/as  adapted  and  revised  for  usg  v;ith 
adult  aides  from  an  observation-rating  form  devised  by  the 
project  co-director  for  use  v;ith  inner  city  youth  (Dalrymple, 
et  al.,  1971).    The  format  of  the  job  persistence  form  was  as 
an  observations-rating  device,  with  space  provided  for  the 
supervisor  to  write  comments  (see  sample  in  Appendix  3). 

Steps  in  the  development  of  the  job  persistence  included. 

1.  Rev/riting  the  original  items  and  adding  other  appro- 
priate items  based  upon  observations  of  the  aides,  conversations 
v;ith  Extension  agents  and  aides,  and  ENEP  '"tate  Administration 
staff;  literature  review  of  work  motivation  and  behavior  in 
industrial  and  labor  psychology  and  new  careers  programs;  and 
consultations  v;ith  resource  persons  at  Cornell  University. 

2.  The  adapted  instrument  v/as  presented  to  a  group  of 
Extension  agents  who  made  several  suggestions  for  revisions, 
based  upon  their  actual  field  experience. 

3.  The  instrument  was  revised  again  and  used  by  two 
supervisory  aides,  in  a  nearby  county  not  in  the  sample,  as  a 
part  of  work  performance  review  for  thirteen  aides. 

4.  Following  this,  further  revisions  were  made  and  a 
group  of  resource  persons  were  asked  if  the  items  described  in 
the  form  indicated  behaviors  v/hich  were  pertinent  to  becoming 
employable  or  remaining  employable;  if  other  behaviors  should 
be  included;  and  if  the  accumulated  score  \vOuld  be  meaningful. 
Resource  persons  included  three  of  the  persons  consulted  in  (1) 
above. 

The  final  version  of  the  job  persistence  form  v/as  prepared 
incorporating  comments  and  suggestions  received  from  the  re- 
source persons.    The  final  form  had  fifteen  items,  thirteen  of 
which  v/ere  scored  using  a  three  point  scoring  system^  The 
scoring  scale  v;as  designed  to  divide  the  aides  into  three 
groups:     those  who  performed  at  the  top  level,  those  who  were 
in  the  middle,  and  those  at  the  low  or  poor  level. 

Data  Collection 

Eleven  Extension  agents  completed  the  forms  for  140  aides 
employed  in  nine  counties  and  Site  Q.    Eleven  supervisory  aides 
completed  the  form  for  103  aides  in  nine  counties.  Extension 
agents  and  supervisory  aides  were  asked  to  separately  (and 
without  consultation)  complete  the  forms  for  all  aides  cur- 
rently employed  and  for  all  interviev/ed  aides    v/ho  had  left 
employment.    The  full  use  of  the  forms  as  an  anecdotal  record 
v/as  illustrated  in  the  Site  Q  Research  Project,  where  super- 


'Aides  v/ho  had  been  interviewed* v/ith  the  teaching- learning 
interview  schedule. 
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visory  personnel  made  observations  of  the  aides  at  several 
points  in  time,  and  indicated  changes  in  behavior. 

Ref  ij-ied^  Version  of  the  Job  Persistence  Foria 

Based  upon  a  summary  of  the  v;ritten  comments  by  the 
Extension  agents  and  supervisory  aides  v;ho  had  completed  the^ 
form,  the  job  persistence  form  was  refinec!  (see  sample  item  in 
Appendix  B)  •    One  nev;  item  was  added,  related  to  the  aide  merit-- 
ing  the  confidence  of  the  supervisory  staff.    Several  refine- 
ments were  made  in  the  scoring  sections. 

peyelppment  of  the^  Attitude  Scale 

The  purpose  of  this  scale  was  to  assess  the  attitudes 
of  aides  tov;ard  the  job  of  being  a  Cooperative  Extension  Aide. 
The  first  step  in  the  development  of  the  LiJccrt- type  scale  v;as 
the  preparation  of  two  open-ended  questiOiinaires  (sample  ques- 
tions are  included  in  Appendix  C)  'designed  to  elicit  comments 
and  statements  regarding  the  job  from  the  aides.    Sleven  aides 
in  one  county  completed  one  questionnaire;  fourteen  aides  in 
tv;o  counties  completed  the  second  questionnaire. 

A  table  of  specifications,  containing  eight  categories, 
was  prepared  using  as  a  model  the  one  developed  by  Jacoby  (1966) 
v;ith  certain  modifications  based  upon  readings  in  industrial 
psychology,  review  of  several  attitude  tov/ard  worJc  scales, 
and  knowledge  of  the  ENEP  and  the  work  of  the  aides. 

An  item  pool  of  178  statements  for  the  eight  categories 
of  the  table  of  specifications  v/as  developed  from  various 
sources  including  a  reviev/  of  several  attitude  toward  work 
scales,  summarisied  statements  from  the  two  questionnaires,  and 
observations  and  comments  obtained  while  interviewing  the  aides 
in  early  1970. 

The  statements  were  then  reviev/ed  by  a  panel  of  six 
judges^    The  judges  v;ere  three  Extension  home  economists, 
the  director  of  the  Human  Services  Training  Project  at  the 
College  of  Human  Ecology,  and  two  graduate  students  v;ho  had 
prior  associations  v/ith  paraprofessionals.    The  judges  were 
asked  to  review  the  statements  and  to  indicate  v^hich  ones 
indicated  a  positive  orientation  to  the  job  and  those  that 
revealed  a  negative  orientation.    Any  statements  that  were 
not  pertinent  to  the  job  of  being  an  Extension  Aide  were  to 
be  crossed  out.    The  judges  were  also  to  indicate  those 
statements  v;hich  were  uncertain  as  to  the  direction. 

The  statements  for  v/hich  four  or  more  of  the  judges  were 
in  agreement  as  to  the  direction  (either  positive  or  negative) 
were  selected  for  the  scale*    This  procedure  yielded  108  items, 
v/hich  were  arranged  in  a  LiLert-type  format,  with  four  options: 
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strongly  agree,  mildly  agree,  mildly  disagree,  and  strongly 
disagree.    The  undecided  response,  used  frequently  in  Likert 
scales,  v;as  oraitted.as  it  v/as  thought  that  aides  might  select 
this  option  rather  than  make  the  agree  or  disagree  choice. 

Data  Collection 

There  v/as  no  other  group  of  aides  available  to  give  the 
scale  to  in  order  to  reduce  the  number  of  itenis  and  to  gain 
experience  in  how  best  to  administer  the  scale.    Therefore  one 
of  the  Extension  agents  in  one  of  the  main  sample  counties  was 
asked  if  she  and  the  aides  would  be  willing  to  complete  the 
scale  on  a  trial  run  basis,  and  to  make  suggestions,  comments, 
etc.,  which  would  be  useful  in  administering  the  scale  to  aides 
in  the  other  counties.    Suggestions  from  this  experience  v/ere 
utilized  in  revising  or  altering  the  statements  and  in  the 
v/ritten  directions  sent  to  the  Extension  agents. 

Copies  of  the  attitude  scales,  directions  for  adminis- 
tration, and  cover  letters  were  sent  to  agents  in  thirteen 
additional  counties  and  Site  Q.    For  ease  in  administering  the 
scale,  it  was  divided  into  two  parts;     part  1  contained  fifty- 
eight  items  ahd  part  2  fifty  items.    Because  of  the  length  of 
the  scalei  agents  were  given  the  option  of  administering  the 
scale  at  one  or  two  in-service  training  sessions.     A  total  of 
161  aides  completed  the  scale. 

The  final  attitude  scales  were  developed  using  a  procedure 
suggested  by  Edv/ards  (1957).    After  the  scales  are  scored,  the 
scores  are  arranged  in  descending  order,  v;ith  the  top  25  per 
cent  of  the  group  and  the  bottom  25  per  cent  selected.  {There 
were  forty  scores  in  each  group.)    To  select  statements  v;hich 
discriminated  betv/een  the  high  and  lov/  scorers,  the  Edwards  t 
procedure  v/as  used.    The  attitude  scale  is  then  composed  of 
statements  with  the  largest  t  values.    Tv/o  scales  v>;ere  devel- 
oped from  the  89  statements  which  had  t  values  of  1,75  and  over. 
The  forty-tv/o  item  scale  had  six  statements  for  each  of  the 
seven  categories  of  the  table  of  specifications.  (Sample 
statements  for  each  category  are  included  in  Appendix  C.) 

It  was  felt  that  the  forty- two  item  scale,  called 
Feelings  Tov/ard  Aide  Jobs,  v/as  a  generalizeable  scale  which 
might  be  applicable  for  aides  in  other  human  services  para- 
professional  jobs.    The  twenty-four  item  scale,  called  Feelings 
Toward  Cooperative  Extension  Aide  Jobs,  contains  statements 
relating  to  the  specific  job  of  being  a  Cooperative  Extension 
Aide. 


Other  Data^  Collected 

Aides  in  ti.e  eight  county  main  sample  v/ere  asked  to 
complete  the  Rotter  I-E  Scale.    This  v/as  done  as  a  part  of 
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One  category  was  deleted  from  the  table  of  specifications. 
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construct  validation    for  the  job  persistence  form.    In  ad- 
dition, employment  application  records  and  family  record,  part  1 
and  2,  were  collected.    These  family  records    are  completed  by 
the  aides  for  the  families  v;ho  are  enrolled  in  ENEP  and  are 
part  of  the  Extension  Service,  USDA  evaluation  prcofram. 
The  Extension  agents  v;ere  also  asked  for  an  indication  of 
potential  supervisory  ability  of  the  aides,  by  naming  those 
aides  who  might  be  capable  of  being  promoted  to  supervisory 
aide  positions,  should  the  opportunity  arise. 

Aides  v/ho  had  been  interviewed  with  the  interviei;  schedule 
and  who  had-  left  employment  were  sent  follox-mp  letters  containing 
the  attitude  scale  and/or  the  Rotter  I-E  Scale.    Tv;nety  aides  in 
the  eight  counties  were  contacted;  response  was  received  from 
thirteen  aides. 


Quali ty  of  the  Inp truments.  Deye loped 

The  next  part  of  this  paper  deals  v;ith  findings  related 
to  the  quality  of  the  three  instruments  developed  in  this 
study.    This  includes  information  regarding  reliability,  item 
discrimination,  and  validity. 


Reliabili t)'-^  of  the^  J^iLsA^umjents 

Reliability  of  an  instrument  is  concerned  with  the 
consistency  or  dependability  of  measurment  over  time.  Appro:ci 
mateiy  the  same  ordering  of  individuals  should  result  from 
repeated  administrations  of  the  instrument,  assuming  similar 
conditions. 


The  Hoyt-Stunkard  analysis  of  variance  procedure  (1952) 
for  internal  consistency  v;as  used,  utilizing  a  computer  program 
developed  in  the  Department  of  Community  Service  Education." 
This  procedure  was  used  because  the  items  have  variable  scoring. 


The  estimate  of  the  reliability 
formula; 

^         _    K.S.  Among 
tt  Individuals 


coefficient  is  obtained  by  this 

M..  S.  Residual 
(Interaction  of  Items 
and  Individuals) 


H.  S.  Among  Individuals 


Hoyt  and  Stunkard  write: 


It  should  be  noted  that  the  numerator  provides  the 
estimate  of  the  '*'true"  variance.    It  is  the  propor-- 
tion  that  this  **true"  variance  among  individuals 
bears  to  the  variance  of  the  obtained  scores  among 
individuals  that  represents  the  coefficient  of 
reliability  (1952:757). 


1 

Family  record  1  provides  infoxnuation  about  the  family;  Family 
Q  record  2  is  the  food  recall  and  contains  a  nutrition  question. 

ERIC 
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The  follov/inc  table  summarizes  the  reliability  coeffi- 
cients of  the  instruments  developed  in  the  study  and  the  Rotter 
I-E  Scale. 


Instrument 


Relia))ility 
coefficient 


Upstate  interview  schedule 
(24  items) 

Refined  interviev/  schedule 
(39  items) 

Attitude  scale 
(42  items) 

Attitude  scale 
(24  items) 

Job  persistence  form  scored  by 
Extension  agents     (13  items) 

Job  persistence  form  scored  by 
supervisory  aides 

Rotter  I-E  Scale 
(23  items) 


89 
26 
151 
161 
140 
103 
113 


•  79 
.91 
.82 
.67 
.00 
.89 
.64 


I tern  pi scr imin ation 

Ahman  and  Glock  (1971)  recommend  the  examining    of  each 
item  in  an  instrument  as  to  its  pov/er  to  discriminate  between 
those  v/ho  receive  high  scores  and  those  \/ho  receive  low  scores. 
An  item  discrimination  computer  program,  developed  in  the 
Department  of  Community  Service  Education,  was  used  to  obtain 
the  indices  of  discriminating  pov;er  for  the  two  interview 
schedules  and  the  job  persistence  forms. 

Item  discrimination  values  for  the  upstate  interview 
schedule  ranged  from  +.10  to  .67.    Ahman  and  Glock,  citing 
Ebel,  suggest  that  for  a  classroom  achievement  test  more  than 
fifty  per  cent  of  the  items  should  have  D  values  above  +.40, 
forty  per  cent  or  less  of  the  items  should  have  values  betv;een 
•^.40  and  +.20,  and  less  than  ten  per  cent  should  have  values 
betv/een  +#20  and  zero.    The  distribution  of  items  following 
this  recommendations  is  given  in  the  follov/ing  table. 
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Recptnmended  proportion    Recommended  distribution  Distribution 
of  items  for  24-item  schedule         of  items  on 

schedule 


50% 
or 

of  items  +.41 
greater 

12 

5 

40% 

of  items  +.20  to  +.40 

10 

13 

10% 

of  items  belov/  +.20 

2 

6 

TOT^oL 

24 

24 

Earlier  it  v/as  stated  that  the  interview  schedule  v;as 
refined  following  administration  to  39  aides.    This  v;as  done 
to  increase  bot'a  the  reliability  coefficient  of  .79  and  the 
discrimination  indices  of  the  items  belov;  •I-.20.    Item  discrimi 
nation  indices  for  the  refined  interview;  schedule  ranged  from 
-.07  to  +#71.    The  following  table  summarizes  the  distribution 
follov/ing  the  Ahman  and  Glock  recommendation. 


Recommended  proportion    Recommended  distribution  Distribution 

of  items  for  39-item  schedule  of  items  on 

schedule 

50%  of  items  +.41  or  20  14 

or  greater 

40%  of  items  +.20  to  +.40  15  19 

10%  of  items  belov;  +.20  4  6 


Since  a  small  number  of  aides  (26)  was  involved  in  this 
item  discrimination  analysis,  in  a  pretest  situation  primarily, 
it  might  be  v;ell  to  consider  these  D  values  as  tentative 
indicators  that  most  of  the  questions  have  at  least  satisfactory 
discriminating  pov/er  to  differentiate  betv/een  high  and  low 
scorers. 
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Job  Per  sis  tence  Foriri 

Discrimination  values  for  the  job  persistence  form  v;ere^ 
also  obtained  using  the  computer  prorram  for  item  discrimination. 
Since  both  the  Extension  agents  and  the  supervising  aides  bad^ 
been  asked  to  score  the  forms  independently,  item  discrimination 
indices  were  obtained  for  each  scordng.    For  both  r-roups  of 
scorers,  three  items  had  discrimination  values  of  +.20  and 
below.    One  question  had  a  value  from  v.2C  to  .40.    nine  items 
had  discrimination  values  from  +.41  to  .GO. 


Validity 

One  of  the  objective:S  of  this  study  \;as  to  validate 
the  nev;ly  developed  instruttients.    Validity  is  considered  to 
be  of  primary  importance  by  measuren\ent  ercperts,  and  is 
defined  by  Ebel  as  the  '^accuracy  with  v;hich  the  tes^  'neasures 
v/hat  it  is  intended  to  measure-  (19GS .  3C3-3S9)  *    According  to 
Cronbach  three  types  of  validity  have  been  discerned: 

Criterion-related    predictive?  validation 
compares  test  scores,  or  predictions  made  from  them, 
v;ith  an  external  variable  /criterion?  coi^^sidered 
to  provide  a  direct  measure"*of  the  characteristic 
or  behavior  in  question.  ^ 

Content  validity  is  evaluated  by  showing  how 
v;ell  the  content  of  the  test  samples  the  class  of 
situations  or  subject  matter  about  which 
conclusions  are  to  be  drawn. 

Construct  val5.dity  is  evaluated  by  investigating 
what    psychological  qualities  a  test  measures;  i.e. 
by  determining  the  degree  to  v;hic3i  certain 
explanatory  concepts  or  constructs  account  for 
performance  on  Ke  test  (1971:444). 

Con tent  Validity 

Content  validity  of  the  three  instruments  was  based 
upon  a  search  of  appropriate  literature  concerning  attitudes 
tov/ard  v;ork,  teaching-learning  principles,  and  general  employ-- 
ment  practices.    References  in  adult  education,  education,  and 
home  economics  education  v/ere  reviev/ed  as  well  as  attitude 
scales  developed  by  others,  and  texts  in  industrial  and  labor 
relations  relating  to  industrial  psychology  and  \/ork.  Experts 
in  adult  education,  educational  psychology,  manpower,  industrial 
and  labor  relations  research,  and  psychology  were  consulted. 
Extension  agent  field  staff,  supervisory  aides,  and  profes- 
sionals either  v/orking  with  or  having  had  prior  associations 
v/ith  programs  utilising  paraprof essionals  were  also  consulted. 
The  advice  of  these  persons  as  the  instruments  were  developed 
aided  in  the  validation  of  their  content. 


(Zriteripn  Validity 


The  criterion  measure  used  in  the  Evaluation  Project  v/as 
based  on  Family  record,  part  2,  the  food  recall.  Despite 
limitations,  the  food  recall  record  does  attempt  to  measure 
the  basic  aim  of  the  program:     improved  nutritional  status  of 
the  client.    The  v/idespread  availability  of  these  recalls  and 
the  fact  that  the  aides  complete  them  as  a  routine  part  of  their 
work,  further  enhanced  the  desirability  of  their  use  as  the 
criterion  measure  for  the  Evaluation  Project. 

The  food  recalls  v;ere  collected  by  Evaluation  Projec^ 
staff  from  county  records.    V/henever  available,  five  pairs 
of  recalls  were  collected  for  each  aide.     It  v/as  f ounu  ':hat 
generally  recalls  v;ere  not  available  for  the  supervisory  aides 
and  some  of  the  former  aides.    For  a  variety  of  reasons,  it 
v/as  not  all/ays  possible  to  collect  five  pairs  of  recalls  per 
aide,  as  had  been  originally  suggested  by  a  statistician  in 
the  Department  of  Education*    Recalls  v/ere  collected  for  65  of 
the  103  aides  in  the  eight  county  main  sample. 

The  recalls  v/ere  scored  by  a  method  devised  and  validated 
by  Loomis  (1973).     Each  record  v;as  scored  as  follov/s:  1) 
practice,  the  24-hour  recall  of  foods  actually  consumed  by  the 
homemaker  or  other  client,     2)  level,  a  retranslation  of  the 
practice  score  to  a  nutritional  level  based  upon  the  basic 
four  food  groups,     3)  knowledge,  based  upon  the  response  by  the 
homemaker  to  the  question,  ''l/hat  foods  and  drink  do  you  think 
people  need  to  be  healthy?*,  and  4)  a  combined  practice  and 
knowledge  score. 

For  statistical  analyses  only  the  scores  from  the  second 
set  of  recalls  v;ere  used.    Each  aide  received  a  mean  score  for 
practice,  level,  knov/ledge,  and  practice  +  knov/ledge  for  the 
recalls  collected  for  that  aide.    The  mean  score  v/as  used  to 
provide  a  more  equitable  score  for  the  aides  v/ho  did  not  have 
five  .pairs  of  recalls.     Based  upon  correlation  data,  the  rela- 
tionships betv/een  scores  from  the  instruments  and  means  scores 
from  the  food  recall  criterion  measure  were  spotty  and  v/eak. 
Lov/  correlation  coefficients,  all  under  .30,  mostly  positive 
but  a  feu  in  the  negative  direction,  v/ere  obtained.     One  reason 
for  the  lov;  correHations  may  be  due  to  what  Nunnally  (1967:126- 
128)  Calls  a  -  restriction  of  range.-    There  v/as  little  room  for 
improvement  on  the  food  recall  measure  on  the  part  of  the  home- 
maker. 

Construct  yalidity 

According  to  Cronbach  (1970:142)  ^^construct  validation  is 
an  analysis  of  the  meaning  of  test  scores  in  terms  of  psycho- 
logical concepts  or  'constructs*."    The  construct  under  inter- 
pretation in  this  study  is  ef fecti\^enoss  of  aides  in  helping 


A  pair  of  recalls  here  refers  to  the  initial  recall  for  a 
family  and  a  subsequent  one,  usually  but  not  always  the 
second  recall  taken  six  months  later. 
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families  to  achieve  the  goals  of  ENEP. 

Tv/o  procedures  of  several  suggested  by  Cronbach  and  Ileehl 
(1S67)  v/ere  pertinent  for  this  study— c:roup  differences  and 
correlation  matrices  and  factor  analysis 

Group  differences  investigated  in  this  study  were  the  mean 
scores  of  tv/o  groupings  of  aides  for  each  of  the  follov/ing  vari- 
ables, tliought  to  explain  or  account  for  differences  betv/een 
high  and  lov;  scorers  on  the  instruments.     1)  education,  2) 
supervisory  ability  (either  actual  or  estimated)  vs»  considered 
not  capable  of  being  a  supervisory  aide,  3)  employed  vs.  former 
aide,  4)  full-time  vs.  part-time  aide,  5)  length  of  time  em«- 
ployed  as  an  aide,  6)  previous  employment  as  an  aide,  7)  number 
of  jobs  held  pre'^iously,  8)  Rotter  I-E  score,  internal  vs. 
external  score,  9)  food  recall  criterion  measure. 

The  results  of  hypotheses  testing  indicated  that  no  one 
variable  accounted  for  group  differences  for  all  instruments. 
Supervisory  ability  and  employment  status  as  an  employed  aide 
v/ere  variables  that  explained  differences  betv/een  high  and  lov/ 
scorers  for  the  interview  schedule,  the  24-item  attitude  scale, 
and  thr  job  persistence  forra  as  scored  by  tlie  supervisory  aides. 
The  internal  score  for  the  Rotter  I-E  Scale  accounted  for 
differences  in  mean  scores  of  tv;o  groupings  of  aides  for  the 
two  attitude  scales.    Variables  v/hich  did  not  account  for  any 
differences  betv/een  mean  scores  of  tv/o  groupings  of  aides  were 
education,  length  of  time  employed  as  an  aide,  previous  employ- 
ment as  an  aide,  and  number  of  jobs  held  previously. 

A  correlation  matrix,  using  scores  from  the  job  persis- 
tence form  and  the  Rotter  I-D  Scale,  v/as  another  method  used 
to  acertain  construct  validity,     '\ccording  to  Cronbach  and 
rleehl  (1967:252),  "if  tv/o  tests  are  presumed  to  measure  the  same 
construct,  a  correlation  betv/een  them  is  predicted.''    The  Rotter 
I-E  Scale,  a  measure  of  generali^ted  expectancy  developed  by 
Rotter  (1966),  v/as  selected  as  an  outside  test  to  help  validate 
the  job  persistence  form.     It  v/as  thought  that  aides  who  had 
lov;  scores  on  the  Rotter  Scale — indicating  a  more  internal 
orientation,  a  belief  that  through  one^s  ov/n  efforts  that  one 
succeeds  (or  remains  employable) — v/ould  receive  high  scores 
on  the  job  persistence  form.    Therefore  a  fairly  high  negative 
correlation  was  e:cpected.    However  the  actual  correlation  be- 
tween the  total  scores  of  the  two  scales  v/as  --.02.    Thus  the 
Rotter  Scale  could  not  be  considered  as  a  way  of  validating 
the  job  persistence  form.     Persistence  on  the  job  is  explained 
by  other  than  the  internal-external  dimension. 

Factor  analyses  of  the  42-item  scale,  the  66-item  scale 
(combining  the  42--item  and  the  24-item  scales)  did  not  reveal 
any  factors  or  constructs  and  so  factor  analysis  was  not  a 
validating  procedure. 
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It  v/as  thought  that  the  limited  range  of  scores  for  the 
food  recall  measure  and  the  lack  of  criterion  scores  for  some 
of  the  aides  (particularly  the  former  aides  and  all  of  the 
supervisory  aides)  influenced  the  outcomes  of  the  criterion 
and  construct  validation.     Improved  criterion  measures  for  aides 
working  with  families  and  for  supervisory  aides  would  be  needed 
in  order  to  fully  assess  the  relationships  between  the  instru- 
ments and  program  outcome  measure. 


Summary 

Instruments  with  satisfactory  reliability  coefficients 
and  item  discrimination  indices  v;ere  developed.  Content 
validitv  was  ascertained  through  literature  review  and  consul- 
tations" with  experts.    The  instruments  had  limited  criterion 
and  construct  validity. 

Recommendations  included  the  following:     the  developm.ent 
of  an  improved  food  recall  criterion  measure  (as  suggested  by 
Synectics  Corporation,  Hunger,  1971)  to  ascertain  client 
progress;  the  development  of  a  criterion  measure  for  the 
supervisory  aides;  the  use  of  other  methods  for  observing  the 
actual  aide-homemaker  interaction  (such  as  rating  scales,  case 
studies,  and  participant  observers)  to  determine  what  elements 
and  conditions  are  essential  to  help  bring  about  client  change; 
and  the  obtaining  of  information  about  other  situational 
influences  which  affect  client  and  program  outcome  such  as 
the  number  and  kinds  of  problems  families  have,  the  family's 
ability  to  change,  the  Extension  agents'  and  supervisory 
aides'  abilities  and  competencies,  and  other  state  and  local 
conditions. 

As  was  stated  earlier,  this  research  study  was  part  of 
an  on-going  evaluation  project  on  the  effectiveness  of  para- 
professionals  in  working  with  lov/-income  families,  under  the 
direction  of  Dr.  Helen  Y.  Nelson  and  Mrs.  Rettie  Lee  Yerka, 
New  York  State  Collecre  of  Human  Ecology,  Cornell  University. 
Loomis  (1973)  developed  and  field  tested  a  food  and  nutrition 
knowledge  test  based  upon  ENEP  goals  for  homemakers.  Engel- 
brecht  (1972)  conducted  a  follow-up  study  of  aides  and  home- 
makers  in  the  eight  county  main  sample  to  obtain  information 
about  homemaker  attitudes  and  behaviors  regarding  the  program 
and  aides.    At  Site  Q,  a  more  controlled  research  effort  is 
underv;ay,  v;ith  both  experimental  and  control  groups  of  home- 
makers,  to  further  assess  aide-client  interaction  and  change. 


Further  information  about  this  instrument  development  study 
may  be  obtained  from  "The  Development  and  Use  of  Instruments 
to  Assess  the  Effectiveness  of  Paraprofessionals  in  VJorking 
with  Low  Income  Families,"  en  unpublished  Ph.D.  dissertation, 
Cornell  University,  Ithaca,  N.  Y. ,  1973,  by  Emilie  Mary 
Stuhlmiller. 
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continued  from  page  23: 
VJork 

13.     I  would  rather  have  a  job  where  I  don't  have  to  make 
decisions. 

26.     I  would  not  be  v/illing  to  go  beyond  what  the  job  requires, 
no  matter  what  else  the  family  needs. 

Rights_  and^^I^espon^  J^E'2l?il^±^ 

11.     I  don't  think  anyone  should  expect  the  aides  to  come 
up  very  often  with  new  suggestions  for  working  with 
families . 

32 o     The  least  important  thing  I  look  for  in  a  job  is  to  be 
treated  as  a  person. 


APPENDIX  A  -  Interview  Schedule  oi  Teaching-Learning  Principles 

One  principle  from  the  grid  of  teaching-learning  principles: 

Adults  have  many  motivations  for  learning.     A  teacher 

can  be  more  effective  v;hen  he  recognises  these  motivations. 

Question  tapping  t>is  staiinent  from  upstate  interview  schedule: 


#42: 


Score; 


Why  do  you  think  some  hom3malcers  are  ready  for  learning  and 
v;hat  you  have  to  tell  and  show  them  (or  teach  them)? 
(Probe:     can  you  tell  me  more  aioout  that?) 

 lo    They  want  to  learn  and  improve  their  homemalcing 

skills  o 

 2.    They  want  to  have  healthier  families;  are 

interested  in  welfare  of  their  families 

 3o    They  are  interested  in  having  someone  come  to 

their  house  (social  needs) 

 4.    The  homemakers  may  want  help  to  solve  some  of 

their  problems 

^  _5.    They  v;ant  to  please  the  aide 

^6o     Other  .  

 ^Aide  is  aware  of  some  of  the  motivations  that 

homemakers  have  for  learning 


(3) 

(2) 
(1) 


 Some  recognition  stated 

 ^Little,  if  any,  recognition  of  motivations  for 

learning 


Question  tapping  this  same  statement  from  the  refined  interview 
schedule: 

#37:     Why  do  you  thinlc  some  homemakers  are  ready  for  learning 
what  you  have  to  teach  them? 
(Probe:     Can  you  tell  me  more  about  that?) 

 1*     They  v;ant  to  learn  and  improve  their  homemaking 

skills;  want  to  learn  new  things 

They  want  to  have  healthier  families;  are 

interested  in  v/elfare  of  their  families;  want 

to  please  family  members 
 3o    They  are  interested  in  having  someone  come  to 

their  home  (social  needs) 
 4^    The  homemakers  may  v/ant  help  to  solve  some  of 

their  problems;  v;ant  to  improve  their  situations 
 5o     Have  had  successful  learning  experiences  and 

therefore  want  to  continue 
6o  Other 


Score:     same  as  given  for  upstate  interview  schedule. 
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;^PPENDIX  B:  Job  Persistence  Form 


Sample  item  from  version  used  in  upstate  Nev;  York: 


#12 o    The  aide's  interest  and  enthusiasm 
for  this  job  as  she  verbalizes 
them  are  characterized  by 
(check  one): 


Scor^e 
3 


(1)  A  feeling  of  satis- 
faction that  she  is 
teciching  families 
about  better  nutriticp. 
and  food  buying  practices; 
is  concerned  for  families 
and  the  help  that  she 

can  give  them 

(2)  A  moderate  feeling  of 
satisfaction  that  she 
is  teaching  families 
about  nutrition  and 
food  buying  practices; 
not  too  concerned  that 
she  can  help  families 

^(1)  A  lack  of  feeling  of 
accomplishment  in  the 
job;  has  little,  if  any, 
concern  that  she  can 
help  families 


Please  v/rite  down 
in  this  column  any 
comments ,  other 
behavior  noted,  to 
substantiate  rating 
given,  if  needed* 


Same  item  from  refined  version  of  the  form: 

#13 •    The  aide's  interest  and  enthusiasm  for  this 
job  as  she  verbalizes  them  are  characterized  by 
(check  one) ? 

(1)  A  feeling  of  satisfaction  that  she  is 

teaching  clientele  about  better 

nutrition  and  food  buying  practices; 

feels  most  of  the  time  that  she  is 

helping  clientele 
 (2)  A  moderate  feeling  of  satisfaction 

that  she  is  teaching  clientele  about 

nutrition  and  food  buying  practices ; 

feels  that  she  sometimes  is  able  to 

help  clientele 
  (3)  A  lack  of  feeling  of  accomplishment  in 

the  job;  feels  that  she  has  little,  if 

any,  ability  to  help  clientele 


APPENDIX  C:    Attitude  Scale 

Selected  questions  from  two  attitude  development  questionnaires: 
Questionnaire  1 

1.    V/hat  are  some  of  the  things  you  like  the  most  about 
your  job? 

?•    In  what  v;ays  do  you  expect  your  supervisor  (or 
Extension  Home  Economisb)  to  help  you? 

Questionnaire  2 

1.    VJhat  kinds  of  satisfaction  does  the  aide  job  give  you? 

What  satisfactions  do  you  expect  the  job  to  give  you? 
4,     How  important  is  nutrition  knowledge  for  the  families 
you  are  working  v;ith?    For  yourself? 

Selected  statements  from  42-item  attitude  scale  for  each  category 
of  the  table  of  specifications: 

Supervir>ion  and  Supervisors 

33 •    It  means  a  lot  to  me  when  my  supervisor  encourages  me  to 
try  out  my  ideas  on  the  job. 

4.  I  like  having  a  job  where  there  is  a  chance  to  be  a  friend 
of  my  supervisor. 

Relationships  with  Families  (Clientele) 

34.    After  a  while  I  think  that  I  will  get  Lired  of  listening  to 
the  problems  and  complaints  that  families  have. 

5.  No  matter  how  unimportant  a  request  from  a  family  may  seem 
to  me,  it  is  important  to  them  that  I  follow  through. 

Continued  Learning  and_ j?rain_in^_  o^  Job 

14.    Since  I've  been  a  homemaker  for  a  while,  I  don*t  see  v;hy 
we  need  to  have  all  this  training. 
8.     I  feel  that  our  beginning  training  was  inadequate  even  for 
starting  the  aide  job. 

Re  1  a  t  ion  s  hi  ps  )^dth  Co-worlcers 

3.     I  find  that  ip.ost  of  the  exchanging  of  ideas  with  the  other 
is  a  waste  of  time. 
22.     I  would  ratiier  have  a  job  where  there  is  less  sharing  of 
ideas  and  less  opportunity  to  help  your  co-workers. 

Inner  Satisf  ac±j^on_^  an  Aide 

6.  On  this  job  I  am  not  encouraged  to  try  out  my  ov;n  v/ay  of 
doing  things. 

25.    There  are  too  few  occasions  on  this  job  when  I  can  use  my 
own  judgment  in  deciding  hov;  to  go  about  doing  my  work. 


continued  on  page  20. 


THE  INFLUENCE  OF  DIFFERENT 
BEHAVIORAL  APPROACHES  ON  JOB 
EFFECTIVENESS  WITHIN  A  UNIVERSITY 
EXTENSION  DIVISION 


James  L.  Whitfield 
University  of  Missouri 


THE  INFLUENCE  OF  DIFFERENT  BEHAVIORAL  APPROACHES  ON  JOB 
EFFECTIVENESS  WITHIN  A  UNIVERSITY  EXTENSION  DIVISION* 


This  study  was  concerned  with  the  manner  in  which  University  Extension 
personnel  view  human  nature  and  the  effect  these  views  have  on  the  fulfillment 
of  organizational  goals •    More  specifically,  the  main  purpose  of  this  study 
was  to  investigate  the  association  between  the  assumptions  an  organizational 
member  makes  about  people  in  general  and  the  individual  member's  job  effective- 
ness* 

INTRODUCTION 

The  correct  explanation  of  human  behavior  has  never  been  an  easy  task 
to  accomplish*    There  appears  to  be  evidence,  however,  that  a  leader,  manager 
or  administrator  with  a  genuine  understanding  of  human  behavior  will  be  more 
effective  in  the  performance  of  his  roles.    Manager.-,  leaders,  administrators, 
and  social  scientists  who  create  and  study  change  situations  find  that  organ- 
izational changes  involve  multiple  sets  of  complex  variables  whose  identity, 
interaction, and  impact  vary  from  situation  to  situation.      Variables  concerned 
with  human  behavior  are  important  examples  of  complex  factors  influencing  the 
effectiveness  of  an  organization  independent  of  whethe'^  it  is  an  industrial 
or  educational  organization. 


Douglas  McGregor    points  out  that  our  present  knowledge  indicates 
there  are  a  number  of  important  characteristics  of  individuals  and  the  work 
environment  that  conventional  management  practice  does  not  take  into  account. 
The  variables  that  most  managers  take  into  account  are  necessary,  but  they 
are  not  sufficient  to  full>  explain  organized  human  effort.     Since  these 
additional  variables  are  not  recognized,  the  relationships  among  them  are 
unknown  to  managers. 


*Based  on  the  authors  unpublished  Ph.D  dissertation  (Florida  State 
University,  1972)  by  the  above  title.    He  is  Assistant  Professor  of  Extension 
Education  and  Area  Director  of  University-wride  Extension,  University  of 
Missouri.    This  paper  was  presented  at  the  Adult  Education  Research  Conference, 
Montreal,  April  6,  1973. 

^Douglas  M.  McGregor,  Leadership  and  Motivation,  ed.  by  Warren  G.  Bennis 
and  Edgar  Schein,  with  collaboration  of  Caroline  McGregor  (Cambridge, 
Massachusetts:  The  M.I.T.  Press,  1966)  p.  202. 
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It  is  generally  agreed  today  that  there  is  no  one  right  way  for  all 
organizations  to  be  managed.    However,  the  fit  between  management's  assumptions 
about  people  in  general  and  the  actual  characteristics  of  organizational  members 
becomes  of  utmost  importance*     The  manager's  assumptions  about  people  will  not 
only  determine  to  some  degree  the  form  of  organization  to  be  utilized  in  ful- 
filling a  task,  but  also  his  management  strategy. 

Extension  activities  at  any  level  involves  the  art  and  skill  of  working 
with  people  to  accomplish  the  objectives  of  the  agency-    Since  human  nature  is 
not  always  predictable  or  rational  an  Extension  educator  must  consider  the 
practical  application  of  the  behavioral  sciences  if  he  is  to  be  effective  in 
performing  educational  roles. 

Generally,  many  of  the  previous  studies  concerning  working  with  and 
through  people  have  failed  to  adequately  deal  with  the  association  between 
leader  behavior  and  the  achievement  of  organizational  goals.    This  is  not  to 
infer  that  previous  studies  have  made  no  contribution  to  the  behavioral  science 
area.     The  findings  have  pointed  out  many  of  the  problems  that  still  exist  as 
attempts  are  made  to  predict  and  control  human  behavior. 

While  many  of  the  investigations  relating  to  leadership,  management, 
and  administration  have  been  conducted  in  business  and  industry,  there  appears 
to  be  much  common  agreement  about  the  universality  of  these  functions  irre- 
gardless  of  the  organization.    Many  of  the  ideas  for  this  research  study  have 
been  borrowed  from  past  studies  involving  business  and  industrial  organizations. 

BASES  FOR  STUDY  VARIABLE  SELECTION 

Behavioral  Science  is  the  study  of  human  behavior  in  a  "scientific" 
manner.    Behavioral  science  studies  behavior,  specifically  human  behavior  in 
response  to  various  stimuli-internal  and  mental,  or  external  and  physical. 
Behavioral  science  suggests  that  man's  actions  are  a  result  and  a  composite 
of  many  variables. 

Much  of  the  concept ical  framework  for  this  study  is  drawn  from 
Douglas  McGregor's  studies.^    He  has  indicated  that  people  generally  have 
seemed  accustomed  to  being  directed,  manipulated,  and  controlled  in  organ- 
izations.   McGregor  further  stated  that  people  have  the  capacity  to  exercise 
self  control  and  must  be  allowed  the  opportunity  to  develop  their  potential 
for  effectiveness  as  an  organizational  member. 


^Douglas  M.  McGregor,  The  Human  Side  of  Enterprise  (New  York: 
McGraw-Hill  Company,  1960.) 
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McGregor  categorized  two  different  sets  of  assumptions  about  human  nature 
and  human  behavior  which  were  designated  as  Theory  X  and  Theory  Y.     These  two  sets 
of  assumptions  form  the  conceptual  foundation  for  the  two  major  variables  of  this 
study.     These  sets  of  assumptions  are: 

* 

Theory  X 

1.  The  average  human  being  has  an  inherent  dislike  for  work  and  will  avoid 
it  if  he  can* 

2.  Because  of  this  human  characteristic  of  dislike  of  work,  most  people 
must  be  coerced,  controlled,  directed,  threatened  with  punishment  to 
get  them  to  put  forth,   adequate  effort  toward  the  achievement  of 
organizational  objectives 

3.  The  average  human  being  prefers  to  be  directed,  wishes  to  avoid 
responsibility,  has  relatively  little  ambition,  and  wants  security 
above  all. 

Additional  beliefs  -  less  explicit,  but  widespread. 

1.  The  average  man  is  by  nature  indolent  -  he  works  as  little  as 
possible. 

2.  He  lacks  ambition,  dislikes  responsibility,  prefers  to  be  led. 

3.  He  is  inherently  self -centered ,  indifferent  to  organizational 
needs . 

A.  He  is  by  nature  resistant  to  change. 

5.  He  is  i,ullible,  not  very  bright,  the  ready  dup<»  of  the  charlatan 
and  the  demagogue. 

Theory  Y 

1.  The  expenditure  of  physical  and  mental  effort  Ir.  work  is  as 
natural  as  play  or  rest. 

2.  External  control   &  the  .l.rcat   of  punishment  are  not  the  only 
means  for  bringing  about  effort  toward  organizational  objectives. 
Man  will  exercise  se If -direct ion  and  self-control  in  the  service 
of  objectives  to  which  he  is  committed. 

3.  Commitment  to  objectives  is  a  function  of  the  rewards  associated 
with  their  achievement. 
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4.  The  average  human  being  learns,  under  proper  conditions,  not  only 
to  accept  but  to  seek  responsibility. 

5-  The  capacity  to  exercise  a  relatively  high  degree  of  imagination, 
ingenuity,  and  creativity  in  the  solution  of  organizational  problems 
is  widely,  not  narrowly,  distributed  in  the  population. 

6.  Under  conditions  of  modern  industrial  life,  the  intellectual 
potentialities  of  the  average  human  being  are  o.iiy  partially 
utilized. 

The  set  of  assumptions  a  manager  holds  about  peo,»le  in  general  will  affect 
the  managerial  strategy  used.     Theory  Y  would  indicate  a' strategy  which  would 
indicate  a  process  primarily  of  creating  opportunities,  releasing  potential, 
removing  obstacles,  encouraging  growth,  and  providing  guidance-     Theory  X  places 
exclusive  reliance  on  external  control  of  human  behavior  rather  than  self-control. 

STUDY  VARIABLES 

The  main  dependent  study  variable  selected  was  job  effectiveness  of 
University  of  Missouri  Extension  field  staff  members.    Job  effectiveness 
ratings,  an  indication  of  the  member's  contribution  to  University  Extension 
Division's  goals,  was  the  variable  measurement.     Each  member's  performance 
was  evaluated  by  the  appropriate  administrator.     Standards  for  evaluation  were 
based  primarily  on  individual  plans  of  work  and  position  descriptions. 

The  primary  independent  study  variable  selected  was  the  Thetay  X- 
Theory  Y  orientation  (attitude)  of  organizational  members.     Supposedly,  the 
assumptions  made  about  people  in  general  would  affect  the  strategy  selected 
by  a  leader,  manager,  or  administrator  in  influencing  or  controlling  human 
behavior.     It  would  seem  important  to  investigate  the  assumptions  made  about 
people  by  University  Extension  professionals,  since  their  main  role  is  to 
effectively  influence  changes  in  human  behavior. 

It  would  seem  evident  that  individual  human  behavior  will  affect  the 
Successful  attainment  of  organizational  goals.     It  is  also  clear  that  attitude 
alone  is  not  the  sole  determinant  of  human  behavior.     For  this  reason,  an 
additional  independent  variable  was  included  in  this  research      The  measure 
for  this  variable  was  also  developed  in  relation  to  McGregor's  Theory  X- 
Theory  Y  formulation  and  was  designated  the  Theory  X-  Theory  Y  behavior  variable. 

Five  intervening  variables  were  included  to  control  for  compounding 
effects  that  might  be  involved.  Tenure  in  the  organization,  position  in  the 
organization,  academic  background,  age,  and  sex  were  selected. 
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The  following  null  hypotheses  we.re  formulated  to  guide  the  investigations* 
There  is  no  significant  association  - 

1-  Between  Theory  X  -  Theory  Y  attitude  and  job  effectiveness. 

2,  Between  X-Y  attitude  and  X-Y  behavior* 

3,  Between  X-Y  behavior  and  job  effectiveness. 

4,  Between  the  combined  effects  of  X-Y  attitude  and  behavior  with  job 
effectiveness. 

5*  Between  job  effectiveness  and  each  of  the  following: 

a*  Tenure  in  the  organization* 
b*  Position  in  the  organization 
c«  Academic  background, 
d*  Age* 
e*  Sex* 

'.f  any  of  the  five  control  variables  were  significantly  associated  with 
job  effectiveness,  the  following  hyp/^theses  would  be  used* 

6*  No  association  between  X-Y  attitudes  and  each  of  the  following: 

a*  Tenure  in  organization* 

b*  Position  in  organization* 

c*  Academic  background « 

d*  Age* 

e*  Sex* 

7*  No  association  between  X-Y  behavior  and  each  of  the  following. 

a*  Tenure  in  the  organization* 
b*  Position  in  the  organization* 
c*  Academic  background* 
d*  Age* 
e*  Sex* 


METHODOLOGY 


The  study  population  included  all  current  members  of  the  University 
of  Missouri  Extension  Division  field  staff  who  were  on  the  Job  prior  to 
January  I,  1969.    Job  effectiveness  ratings  were  not  available  for  persons 
joining  the  field  staff  after  that  date.    The  study  population  totaled  326 

persons. 

University  of  Missouri  Extension  Division  records  and  a  nail  question- 
naire were  used  to  gather  information  for  this  research.    Individual  Job 
effectiveness  ratings  were  secured  from  University  records  and  other  variable 
measurements  were  acquired  through  the  use  of  the  mail  questionnaire. 

The  mail  questionnaire  was  divided  into  three  sections.    The  first 
section  was  designed  to  measure  the  Theory  X-  Theory  Y  behavior  of  Ihe 
population  by  asking  for  responses  to  the  questions  about  a  case  problem. 
The  next  section  was  formulated  to  collect  personal  and  situational  information 
which  would  be  used  as  measures  for  the  control  variables.    An  attitude  instru- 
ment made  up  the  last  section  of  the  questionnaire  and  was  included  to  measure 
the  Theory  X-  Theory  Y  attitudes  of  the  respondents. 

SECTION  I  OF  INSTRUMENT 

The  instrument  included  a  case  problem  about  which  the  study  population 
were  asked  a  series  of  questions.    The  purpose  of  this  section  was  to  arrive  at 
a  measure  of  the  behavior  (Theory  X  or  Theory  Y)  which  would  be  elicited  by 
individual  responses  of  organizational  members. 

The  three  questions  asked  about  the  case  problem  were: 

1.  If  you  (the  Area  Director)  were  to  ask  five  questions,  what 
information  would  you  wish  to  get?  From  whom?  Please  rank 
these  questions  in  order  of  importance* 

2.  How  do  you  explain  the  situation  described  in  the  case  study? 

3.  What  action  would  you  take  if  you  were  the  Area  Director  for 

Extension? 

Responses  to  the  case  study  questions  were  scored  by  a  panel  of  four 
judges  familiar  with  McGregor's  Theory  X  -  Theory  Y  formulation.    These  Judges 
had  prior  training  and  practice  sessions  before  the  actual  scoring  of  returns 

was  initiated. 
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Judges  scored  the  responses  to  each  question  on  a  scale  from  zero  to 
ten,     A  score  toward  the  zero  end  of  the  continuum  indicated  a  tendency  toward 
a  Theory  X  -  type  behavior  while  a  score  falling  near  ten  suggested  a  Theory  Y- 
type  behavior. 

Evidence  of  judge  reiie^-lity  was  established  using  trie  analysis  of 
variance  statistical  method.     Ratios  were  calculated  for  variances  among 
questions,  judges  and  individuals.     The  variance  due  to  the  interaction  of 
judges  and  questions  ratioed  to  the  variance  of  individuals  was  .004299,  This 
ratio  was  accepted  as  sufficient  trvidence  of  tne  consistency  of  judge's  scoring. 

SECTION  II  OF  INSTRUMENT 

This  section  of  the  questionnaire  furnished  me.     res  of  the  five  selected 
control  variables. 

SECTION  III  OF  INSTRUMENT 

The  final  section  of  the  instrument  was  designed  to  measure  the  Theory  X- 
Theory  Y  attitude  of  organizational  members.     Item  statements  were  developed  and 
the  study  population  responded  on  a  Likert-type  scale. 

An  example  of  an  item  statement  included  in  the  attitude  section  of  the 
questionnaire  is  as  follows: 

1.  The  more  a  person  feels  free  to  set  his  own  work  goals,  the  greater 
his  productivity  tends  to  be. 


Strongly  Agree  Undecided         Disagree  Strongly 

^8^^^  Disagree 

A  respondent  checking  strongly  agree  was  given  a  score  of  five  V7hile  one 
checking  strongly  disagree  was  given  a  score  of  one.  Those  individuals  scoring 
higher  were  considered  to  be  more  Theory  Y  -  oriented. 

A  total  of  thirty  item  statements  were  included  in  the  final  instrument. 
These  items  were  selected  based  on  the  pre-test  results. 

Selected  statements  designed  to  elicit  a  response  indicating  a  Theory  X- 
Theory  Y  orientation  were  compiled  and  submitted  to  the  author's  research  committee. 
Suggestions  for  improvement  were  incorporated.     Forty-seven  attitude  statements, 
randomly  ordered,  were  included  in  the  initial  instrument.     Some  statements  were 
favorable,  some  unfavorable,   toward  the  attitude  object.    Graduate  students  in 
Adult  Education  and  a  sample  of  Florida  Extension  workers  formed  the  pre-test  group. 
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The  information  drawn  from  the  pre*test  was  analyzed  using  the  . 
Weight  Questionnaire  Analysis  Computer  Program  at  Florida  State  University. 
Item  statements  showing  low  or  negative  correlations  were  elminated.  Only 
those  items  showing  a  correlation  of  .30  or  higher  with  total  scores  were 
retained.    Based  on  this  analysis »  30  item  statements  were  included  in  the 
final  attitude  instrument. 

The  research  instrument  was  mailed  to  326  University  of  Missouri 
Extension  field  staff  members  on  July  23,  1970.    A  total  of  296  question- 
naires were  received  for  a  90.8  percent  return.    Ten  of  these  instruments 
were  too  incomplete  to  be  usable. 

In  order  to  establish  a  reliability  measure  for  the  attitude  instrument, 
the  split-half  method  was  employed*    The  reliability  coefficient  of  the 
attitude  section  of  the  final  instrument  was  calculated  to  be  .75. 


DATA  AMALYSES 

TABLE  1.  — Distribution  of  respondents  by  Theory  X  -  Theory  Y  attitude  item 
scores  and  categories  of  Job  effectiveness  rating. 


Theory  X  *  Theory  Y  Attitude  Item  Scores 


Low 

Medium 
Low 

Medium 
Hi^h 

HiRh 

Category 

Number 

Per 
cent 

Per 
cent 

Per 
cent 

Per 
cent 

Mean  Item 
Score 

1 

126 

7.9 

26.2 

43.7 

22.2 

3.75 

2 

130 

17.7 

29.2 

38.5 

14.6 

3.62 

3  and  4 

30 

26.7 

33.3 

23.3 

16.7 

3.57 

Total 

'% 

14.3 

28.3 

39.2 

18.2 

3.69 

X^  -  13.0096  df«  6  p  ^  .05 

Data  used  in  testing  this  hypothesis  are  presented  in  Table  1  It 
was  found  that  only  7.9  per  cent  of  respondents  rated  in  the  number  1  (excellent) 
job  effectiveness  rating  category  scored  low  on  the  X     Y  attitude  measure,  while 
26.7  per  cent  of  respondents  rated  in  the  3  (adequate)  and  4  (unsatisfactory) 
rating  categories  scored  low  on  the  attitude  measure. 
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Approximately  66  per  cent  of  the  respondents  rated  in  the  category  1 
(excellent)  of  job  effectiveness  scored  medium  high  or  higher  on  the  attitude 
instrument  while  only  40  per  cent  of  respondents  rated  3  (adequate)  or  4 
(unsatisfactory)  scored  medium  high  or  higher  on  the  attitude  instrument.  The 
mean  item  score  for  respondents  rating  number  1  was  3.75  while  the  mean  for 
those  rating  3  or  4  was  3.57.    The  overall  mean  X  -  Y  attitude  item  score  was 
3.69. 


The  chi-square  value  of  13.0096  was  significant  at  the  .05  level  of 
confidence. 


TABLE  2.  --Distribution  of  respondents  by  Theory  X  -  Theory  Y  attitude  item 
scores  and  Theory  X  -  Theory  Y  behavior  scores 


Theory  X  -  Theory  Y  Behavior  Scores 


Theory  X  - 

Very 
Low 

Low 

Medium 

High 

Very 

HiRh 

Theory  Y 
Attitude 
Item  Score 

N 

Per 
cent 

Per 
cent 

Per 
cent 

Per 
cent 

Per 
cent 

Low 

39 

28.2 

17.9 

20.5 

20.5 

12.9 

Medium  Low 

82 

12.2 

19.5 

36.6 

20.7 

11.0 

Medium  High 

113 

10.6 

23.9 

30.9 

21.3 

13.3 

High 

52 

7.7 

17.3 

19.2 

28.9 

26.9 

Total 

286 

13.0 

20.6 

29.0 

22.4 

15.0 

=  21.72 

df=  12 

P< 

.05 

Data  concerning  the  association  between  Theory  X  -  Theory  Y  attitude  and 
behavior  are  presented  in  Table  2.    These  data  indicate  that  28.2  per  cent  of 
respondents  scoring  low  on  X  -  Y  attitude  also  scored  very  low  on  the  X  -  Y 
behavior  measurement.     However,  only  7.7  per  cent  of  those  scoring  high  on  the 
attitude  measurement  scored  very  low  on  the  behavior  measurement.  Twenty- 
seven  per  cent  of  the  respondents  scored  high  or  very  high  on  both  variable 
measurements  while  only  12.9  per  cent  scoring  low  on  the  X  -  Y  attitude  measure- 
ment scored  very  high  on  the  X  -  Y  behavior  variable  measurement. 
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TABLE  3.  Distribution  of  respondents  by  Theory  X  -  Theory  Y  behavior  scores  and 
job  effectiveness  ratings 


Theory  X  -  Theory  Y  Behavior  Scores 


Very 
Low 

Low 

Medium 

High 

Very 
High 

Category 

Number 

Per 
cent 

Per 
cent 

Per 
cent 

Per 
cent 

Per 
cent 

Mean 
Score 

1 

126 

4.8 

12.7 

33.3 

26.2 

23.0 

6.375 

2 

130 

14.6 

26.9 

29.2 

20.0 

9.3 

5.795 

3  and  4 

30 

40.0 

23.3 

20.0 

13.3 

3.4 

5.276 

Total 

286 

12.9 

20.3 

30.1 

22.0 

14.7 

5.994 

Of  those 

=  44.3 
respondents  rated 

df=  8 
in  category. . . . 

P 

<.001 

1  (excellent),  only  17.5  per  cent  scored  low  or  very  low  on  the  behavior  variable 
score  while  63,3  per  cent  of  respondents  rated  3  (adequate)  or  4  (unsatisfactory) 
also  scored  low  or  very  low  on  the  Theory  X  -  Theory  Y  behavior  variable  measure- 
ment. 


Statistically,  a  chi-square  value  of  44.3  was  obtained  whicli  is  significant 
at  the  .001  level  of  confidence. 


A  tabulation  of  respondents  by  X  -  Y  behavior  scores  and  job  effectiveness 
ratings  is  presented  in  Table  3.    Almost  two-thirds  (63.3  per  cent)  of  respondents 
rated  in  the  rating  category  3  (adequate)  or  4  (unsatisfactory)  also  scored  low  to 
very  low  on  the  X  -  Y  behavior  measurement.     Conversely,  approximately  50  per  cent 
of  the  respondents  rated  1  scored  high  to  very  high  on  the  behavior  variable  measure- 
ment. 
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TABLE  4,  Multiple  correlation,  multiple  linear  regression,  and  analysis  of 
variance  statistical  results  involving  the  three  major  study  variables. 


Popu lation 
Statistic 


X  -  Y  Attitude 

and  Job 
Effectiveness 


X  -  Y  Behavior       X  -  Y  Attitude, 

and  Job  Behavior  and  Job 

Effect  iveness         Ef f ec  tiveness 


Multiple 
Corre lation 

Coefficient  0.1790 
Coefficient  of 

Determination  0. 0320 

Analysis  of  Variance 
for  Multiple  Linear 
Regression 

Degrees  of  Freedom 

Due  to  Regression  1 

Degrees  of  Freedom 

Due  to  Deviation 

About  Regression  284 

Sum  of  Squares  Due 

to  Regression  4.31668 

Mean  Squares  4.31668 
F-Value  9.39830** 

Regression 

Coefficient  0.01180 


Computed  t  -  Value  3.06567** 


0.3451 


0.1191 


284 

16.04497 

16.04497 
38.38450*** 

0.02117 

6.19552*** 


0.3619 


0.1310 


283 

17.65129 

8.82565 
21.32790*** 


0.00736  A 
0.01974  B 

1.97003*  A 
5.67664***B 


*p   <  .05 
**p  <  .01 
***p  <  .001 


A  •  Attitude 
B  =  Behavior 
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The  two  independent  variables  were  analyzed  separately  with  the 
dependent  variable  before  considering  all  three  variables  simultaneously. 
Table  4  contains  the  statistical  analysis  of  the  association  among  the  three 
major  study  variables. 

The  multiple  correlation  coefficient  was  0.1790  when  analyzing  the 
association  between  X  -  Y  attitude  and  job  effectiveness  rating.      An  application 
of  the  F-test  produced  an  F-value  of  9.3983  which  was  significant  at  the  .01 
level  of  confidence.    The  student's  t-test  of  significance  indicated  whether 
the  calculated  regression  coefficient  was  significantly  different  from  0.  The 
t-value  of  3.06567  was  significant  at  the  .01  level  of  confidence. 

The  multiple  correlation  coefficient  calculated  when  analyzing  the 
linear  association  between  X  -  Y  behavior  scores  and  job  effectiveness  is 
considerably  higher  at  0.3451.    An  application  of  the  analysis  of  vari£\nce 
test  shows  a  calculated  F-value  of  38.3845.    This  value  indicates  a  highly 
significant  association,  beyond  the  .001  level  of  confidence,  between  these 
two  variables.    The  student's  t-test  was  used  to  determine  if  the  regression  co- 
efficient was  signif icartly  different  from  zero.    A  calculated  t-value  of 
6.19552  was  also  highly  significant  beyond  the  .001  level. 

As  the  associations  of  the  two  Independent  variables  to  the  dependent 
variable  were  analyzed,  additional  data  became  available.    The  addition  of  the 
X  -  Y  attitude  variable  only  increased  the  multiple  correlation  coefficient 
from  0.3451  to  0.3619  and  the  coefficient  of  determination  from  0.1191  to 
0.1310  as  seen  in  Table  4.    Again,  using  the  analysis  of  variance  technique 
to  test  the  hypothesis  that  the  combined  effect  of  the  variables  exercises 
no  influence  on  the  dependent  variable,  a  calculated  F  -  value  of  21.3279 
was  significant  at  the  .001  level.    Students  t-tests  of  the  X  -  Y  attitude  - 
job  effectiveness  association  showed    a  t-value  of  1.970025  which  was  significant 
at  the  .05  level.    The  t-value  calculated  on  the  X  -  Y  behavior  -  job  effective- 
ness association  was  5.67664  which  was  highly  significant  at  the  .001  level  of 
confidence. 

TABLE  5.         Distribution  of  respondents  by  tenure  in  the  organization  and 
job  effectiveness  rating 


Tenure >  Years 


0-5 

6-10 

11-15 

16-25 

26-over 

Rating 

Per 

Per 

Per 

Per 

Per 

Category 

Number 

cent 

cent 

cent 

cent 

cent 

1 

126 

12.7 

16.7 

32.5 

33.4 

4.7 

2 

130 

26.2 

14.6 

21.5 

27.7 

10. 0 

3  and  4 

30 

30.0 

26.7 

16.7 

23.3 

3.3 

Total 

286 

20.6 

16.8 

25.9 

29.7 

7.0 

=  17.59 

df=  8 

P 

<  .05 
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A  large  majority  of  the  organizational  members  rated  in  the  number  1 
category  had  completed  over  10  years  of  service  in  the  organization.  Approximately 
71  per  cent  of  those  rated  number  1   (excellent)  had  over  11  years  of  tenure. 
By  way  of  comparison,  56.7  per  cent  of  respondents  rated  3  (adequate)  or  4 
(unsatisfactory)  had  completed  10  years  or  less  with  the  organization.  The 
average  years  of  tenure  in  the  organization  were  13.8. 

A  calculated  chi-square  value  of  17*59  was  significant  at  the  .05  level 
of  confidence.    The  hypothesis  was  rejected.    The  tenure  variable  was  included 
with  the  major  independent  study  variables  for  further  analyses. 


STUDY  FINDINGS 

Each  of  the  null  hypotheses  involving  the  four  major  study  variables 
Theory  X  -  Theory  Y  attitude  and  behavior  and  job  effectiveness  of  organi- 
zational members  were  rejected.     The  findings  are  summarized  as  follows: 

1.  A  significant  association  was  discovered  between  X-Y  attitude 
scores  and  job  effectiveness  ratings.     Those  receiving  a  high 
attitude  score  (tending  toward  a  Theory  Y  orientation)  on  the 
X-Y  attitude  measurement  also  tended  to  rate  in  a  higher  job 
rating  category. 

2.  Empirical  evidence  indicates  a  significant  association  exists 
between  Theory  X  -  Y  attitude  and  behavior  scores  of  organi- 
zational members.     Respondents  receiving  higher  X-Y  attitude 
scores  also  tended  to  score  higher  on  the  X-Y  behavior  measure^ 
ment . 

3.  Respondents  with  behavior  scores  falling  toward  the  Y  end  of 
an  X  -  Y  continuum  tended  to  consistently  rate  in  a  higher  job 
effectiveness  rating  category  than  those  scoring  toward  the 

X  end.     The  calculated  chi -square  value  regarding  the  associ- 
ation of  these  two  variables  was  44.3  which  was  highly  signif- 
icant beyond  the  .001   level  of  confidence* 

4.  The  two  independent  study  variables,  Theory  X  -  Theory  Y  atti- 
tude and  behavior,  were  combined  and  regressed  on  the  dependent 
variable,  job  effectiveness.     The  combined  effect  of  X-Y 
attitudes  and  behavior  on  job  effectiveness  indicated  the 
existence  of  a  highly  significant  association.     Both  F-values 

and  t-values  were  significant  beyond  the  ,001   level  of  confidence. 

Of  the  five  control  variables,  only  tenure  in  the  organization  was 
significantly  associated  with  job  ef f ect ivenesso     The  other  four  control 
variables  were  eliminated  from  further  study« 

Since  tenure  was  significantly  associated  with  job  effectiveness, 
it  was  deemed  necessary  to  investigate  the  possible  association  between  tenure 
and  X-Y  attitude  and  behavior  for  any  confounding  that  might  exist.  There 
was  not  sufficient  evidence  to  support  tha  existence  of  an  significant 
association  between  tenure  and  either  X-Y  attitude  or  behavior. 
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This  session  is  designed  to  provide  up  to  date  information  on 
developments  at  the  Open  University.    It  is  based  on  information  and  data 
gathered  during  a  recent  visit  to  the  Open  University  and  materials  collected 
over  the  past  few  years  from  and  about  that  institution.    I  hope  that  you  will 
feel  free  to  discuss  not  only  areas  to  which  I  refer  but  any  other  aspects  of 
the  Open  University. 

The  post-natal  investigation  of  the  Open  University  in  Britain 
is  now  well  under-way.    The  establishment  of  a  research  institute,  the  Institute 
of  Educational  Technology,  and  the  accumulation  of  information  from  its  early 
years  have  made  analysis  possible.    A  limited  amount  of  data  is  now  available 
for  the  examination  of  the  student  community;  curriculum;  the  role  of  media  in 
the  institution;  the  effectiveness  of  materials,  of  summer  residential  sessions, 
and  of  regional  centres;  and  the  staff  of  the  institution. 

It  should  be  pointed  out  that  much  of  the  data  that  is  available 
is  of  limited  scope,  and  this  is  in  part  due  to  the  short  life  span  of  the 
institution.    It  is  also  due  in  part  to  the  problems  involved  in  accumulating 
data  about  a  very  complex  and  geographically  large  operation. 

The  fears  of  the  staff  of  the  consequences  of  a  change  in 
government  have  subsided  for  the  most  part.    The  University  was  conceived  with 
political  overtones  by  a  Labour  Government,  and  the  Conservative  opposition  was 
considerable.    Since  assuming  office,  the  Conservatives  have  tightened  budgets 
and  applied  pressure  for  the  admission  of  younger  students.    However,  it  has  not 
attempted  to  destroy  the  institution  by  cutting  drastically  its  financial  support 
as  was  originally  feared. 

The  early  aspirations  of  developing  a   working   man*s  university 
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as  envisaged  in  rhe  "Glasgow"  speech  of  Harold  Wilson  in  1963  have  clearly 
not  been  realized.    Although  information  which  we  have  about  the  student  body 
is  not  as  informative  as  it  should  be,  it  is  clear  that  the  Open  University 
has  not  attracted  many  people  from  unskilled  and  semi-skilled  groups.  There 
are  a  number  of  reasons  for  this,  and  I  shall  refer  to  them  in  a  section  of 
the  paper  which  deals  with  the  student  community. 

One  other  point  that  I  would  like  to  make  as  a  part  of  this 
general  introduction  is  that  the  Open  University  is  quite  clearly  a  British 
institution  arising  within  a  particular  social  context.    It  has  been  greatly 
influenced  by  British  society,  by  the  British  view  of  a  university  and  by  the 
staff  which  fought  very  hard  to  achieve  "academic  respectability"  in  the 
British  university  system.    It  is  important  to  remember  the  differences  between 
the  British  university  system  and  our  own  when  examining  material  and  data 
which  come  from  that  source. 

STUDENTS ; 

The  total  number  of  students  is  approximately  44,000  this 
academic  year  (1973).    The  lower  age  limit  for  entry  was  set  at  .1  years  of  age. 
The  vast  majority  of  students  are  between  the  ages  of  21  and  45  years,  although 
most  of  the  applicants  fall  in  the  range  of  21  to  28  years  of  age. 

The  age  limitation  may  be  altered  within  the  near  future.  Under 
considerable  governmental  pressure,  the  Open  University  admitted  500  students 
who  were  between  the  ages  of  18  and  21  years.    This  was  done  on  an  experimental 
basis.    The  Open  University  agreed  to  admit  these  students  and  to  evaluate  their 
performance  and  impact  before  a  decision  would  be  made  to  make  a  policy  change. 

It  seems  clear  to  me  that  students  entering  directly  from 
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secondary  level  of  education*  will  perform  well  academically* 

If  the  University  wishes  to  retain  its  role  as  provider  of 
opportunities  to  persons  who  have  "missed"  them  previously,  it  will  have  to  avoid 
simply  becoming  another  link  in  the  regular  university  chain.    It  will  need  to 
cling  steadfastly  to  its  very  reasonable  age  requirement.    It  must  advocate  the 
provision  of  other     portunitles  for  those  groups  who  are  cicrently  being 
neglected.    It  must  not  become  the  buffer  institution  which  expands  or  contracts 
according  to  the  number  of  persons  who  have  received  GCE  certificates  in  any  . 
given  year* 

Approximately  two  thirds  of  all  students  are  male,  the  ratio  of 
male  to  female  students  is  established  on  the  basis  of  applications.    The  total 
number  of  applications  from  members  of  both  sexes  is  found.    Then  the  percentages 
of  applications  is  used  to  establish  the  percentages  allocation  of  places.  This 
must  be  integrated  with  other  percentage  allocation  on  the  basis  of  Faculty, 
regional  allocations,  and  special  groups  in  the  community. 

The  regional  allocations  are  based  on  combinations  of  the 
population  of  the  region  and  the  percentages  of  total  applications  coming  from 
the  particular  region.    This  appears  to  favour  slightly  London  and  the  south- 
east region  when  one  examines  the  final  allocation  of  places. 

There  is  also  an  attempt  to  limit  the  number  of  teachers  who 
receive    places  in  the  institution.    Because  they  have  had  a  very  good  response 
in  previous  years  from  the  teaching  profession,  a  limit  of  30%  of  total 
places  has  been  set  for  teachers.    There  are  other  special  groups  in  the 

student  body  Including  people  in  prisons,  the  blind,  the  deaf,  spaetics  and 


*  there  are  a- large  number  who  have        the  qualifications  to  enter  university 
ERXC"  fewer  than  50%  with  the  entry  qualifications  find  places  in  the  regular 

British  university  system. 
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persons  serving  lithe  inerchant  navy.    The  experimental  progrananes  for  the  groups 
just  mentioned  are  very  limited  in  terms  of  total  number  of  places  allocated. 

The  categories  of  occupation  of  applicants  comes  from  the  system 
derived  by  the  Government  of  the  United  Kingdom  for  categorizing  the  population's 
occupational  groups.    These  groups  arc  somewhat  misleading  in  socio-economic 
terms,  and  it  is  difficult  to  use  these  figures  to  develop  certain  conclusions 
about  the  socio-economic  background  of  students.    However  it  does  become  clear 
when  talking  with  members  of  the  staff  of  the  Open  University  that  the  "working'' 
class,  and  I  use  the  term  in  the  British  sense,  is  not  well  represented  in  the 
student  body.    Because  of  British  society's  attitude  toward  higher  education  and 
the  fact  that  some  of  the  staff  of  the  Open  University  perceive  the  University 
from  a  traditional  perspective,  the  students  which  it  seeks  to  attract  and  the 
means  by  which  it  advertises  its  programme  to  prospective  students  does  not 
appeal  broadly  to  this  very  large  segment  of  the  British  population. 

A  student  council  has  recently  been  formed  including  regional 
representatives  to  promote  a  sense  of  community    among  the  students. 
A    newspaper  which  until  now  has  been  produced  by  the  staff  of  the  Department 
of  Steff  and  Student  Affairs  will  be  used  by  the  council.    Television  and 
radio  times  have  been  set  aside  for  extra-curricular  activities  to  develop  the 
sense  of  "community". 

It  should  be  noted  that  a  number  of  student  societies  have  arisen 
based  mainly  c.i  the  areas  of  study.    One  of  the  most  interesting  is  the  society 
which  has  developed  for  the  promotion  of  the  study  of  medicine  in  the  Open 
University.    Although  this  is  not  a  part  of  future  plans,  this  group  is  an 
internal  lobby  for  students   who    wish  the  inclusion  of  a  medical  programme  in 
the  institution. 
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FACULTY: 


On  reflection,  the  academic  staff  appears  to  be  very  competent, 
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There  Is  a  central  core  which  is  mainly  responsible  for  the  productiou  of 
programmes  supported  be  a  large  part-time  staff  of  tutors  and  counsellors  and 
full-time  senior  tutors  and  counsellors.  The 
faculty  at  the  central  location  of  the  University  is  supplemented  for  course 
development  by  well-knovm  faculty  of  other  Universities  as  well  as  other 
Siembers  of  the  staff  of  regional  offices. 

The  ratio  of  academic  staff  to  students  is  low  by  other 
university  standards.    In  1972  thafull-time  academic  staff  included  175  of  the 
central  office,  95  in  the  regional  offi  ces  for  a  total  of  270.    There  were 
4,430  part**time  academic  student.^  including  2,947  tutors  and  1,483  counsello/s. 

Tine  role  of  the  counsellors  in  the  system  is  still  unclear.  Is 
it  academic  or  non-acade.i)lc?    Some  have  pursued  the  academic  role  axA  become 
Involved  in  the  academic  content  of  the  student  programme.    Others  have  assumed 
a  more  traditional  personal  counselling  role.    The  academic  role  has    been  played 
only  in  the  first  year  of  stvdy.    Tutors  have  jealously  guarded  the  right  to 
perform  this  function  in  the  advanced  years  of  study.    There  is  still  some 
question  about  the  future  role  of  the  counsellor  within  the  programmes  of  study 
for  students. 

The  snail  staff  has  meant  heavy  loads  for  all  members  and  little 
opportunity  for  leaves.    The  additiou  of  outside  academics  has  helped  in  course 
development  but  much  of  the  wo^^k  Jeprmds  upon  the  central  staff.    There  har  been 
limited  impact  on  the  curriculum  by  studen^^s.    Ic  is  hoped  that  this  will  increase. 
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The  most  notable  Impact  of  students       curriculum  has  been  in 
the  area  of  half  courses  which  ^       presented  last  year  by  the  Open  University. 
It  was  discovered  that  these  cou.     s  involved  virtually  as  much  work  as  a  full 
course.    Students  protested  about  this,  and  alterations  have  beer  made  in  the 
curriculum. 
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The  attempts  to  promote  interdisciplinary  courses  and  the 
problems  of  course  development  have  complicated  the  life  of  the  academic  in 
the  Open  University,    The  problem  of  dividing  a  course  up  into  several  parts 
and  having  individual  academics  responsible  for  each  unit  has  meant  that 
course  development  occurs  on  a    peace  meal   basis,  and  good  co--ordination  has 
not  always  been  achieved.    Because  many  courses  are  inter-disciplinary  in 
nature,  the  assumptions  which  academics  make  about  the  background  of  students 
and  the  information  which  has  been  provided  to  students  in  other  units  is  not 
always  correct.    Tutors  do  provide  opportunities  for  group  meetings  or  for 
sessions  with  individual  students  who  require  assistance.    Group  meetings  occur 
with  a  frequency  related  to  the  attitude    of  the  individual  tutor  and  the  naeds 
of  the  group  of  students  with  which  he  is  working. 

UNDERGRADUATE  CURRICULUM; 

I  have  already  referred  to  some  of  the  problems  of  course 
development  in  the  section  on  the  Faculty.      Another  major  difficulty  was  and  is 
the  shortness  of  time  available  in  course  development  for  the  problem  of 
intergrating  traditional  academic  approaches  with  the  idedia  and  correspondence. 
The  amount  of  time  required  to  produce  programmes  was  seriously  underestimated 
in  the  initial  stages  of  development  of  the  institution. 

This  process  of  course  development  is  well  described  in  two  papers 
by  Professor  Brian  Lewis  who  is  director  of  the  Institute  of  Educational 
Technology  of  the  Open  University.*    He  indicates  that  one  of  the  major  problems 
IS' in  the  designing  of  individual  \v\ts  of  which  courses  would  be  comprised. 

*  Brian  N.  Lewis:    Course  Production  at  the  Open  University  I:  Some  Basic  Problems 

:    Course  Production  at  the  Open  University  II;  Activities  and 
Activity  Networks 
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Other  problems  include  lack  of  experience  in  working  with  correspondence 
lessons  which  are,  in  my  view,  the  backbone  of  the  prograirane  and  lack  of  under- 
standing of  the  tise  of  media  within  the  educational  setting  on  a  mass  student 
body  basis. 

As  I  here  already  indicated,  the  undergraduate  programmes  have 
taken  the  bulk  of  time  and  money  available  for  course  development.  Post- 
gradiiate  and  post-experience  courses  will  be  referred  to  in  a  later  session. 

Supplementary  materials  for  courses  have  beei  slou-  to  develop 
bacause  of  the  lack  of  funds.    I  was  told  that  it  would  not  be  possible  to 
provide  audio  tapes  to  students  this  coming  year  because  funds  would  simply 
not  be  available  to  develop  this  on  a  large  scale.    Howe/^r,  I  note  on  their 
1973  budget  that  they  have  funds  allocated  for  this. 

POSTGRADUATE  AND  POST-EXPERIENCE  CimRICULA; 

There  has  been  only  a  limited  involvement  in  the  areas  of  post- 
graduate and  what  they  refer  to  as  post-experience  courses.  Post-experience  of 
course  refers  to  further  or  continrlng  education  of  courses. 

.     Postgraduate  courses  as  present  are  being  pursued  in  a  very 
traditional  pattern  because  the  lack  of  funds  to  develop  programmes.    There  are 
a  few  postgraduate  students  working  with  the  academic  staff  at  the  central  office 
of  the  Open  University.    It  is  hoped  that  more  students  will  be  able  to  become 
involved  in  less  traditional  programmes  in  the  future  through  the  use  of 
resources  .in  local  communities.    The  staff  will  assess  the  adequacy  of  resources 
In  any  applicant's  area  before  giving  approval  to  his  graduate  programme. 

There  are  currently  six  post-experience  courses  being  offered 
through  the  Open  University.    These  courses  are  in  mathematics,  science  and 
Er|c  science  areas.    It  is  hoped  that  when  funds  are  available  extensive 

development  .  f  these  programmes  will  take  place. 
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In  1971  the  B.B.C.  staff  included  59  producers,  68  administrators, 
165  support  staff  and  70  secretarial  or  clerical  staff  for  a  total  of  310.  One 
of  the  mistakes  made  at  the  beginning  of  the  university  by  the  B.B.C.  was  to 
hire  producers  who  had  academic  background  but  little  technical  experience. 
The  result  of  this  was  that  producers  were  able  to  talk  with  academics  but  not 
able  to  do  a  very  good  job  with  the  technical  side  of  production  of  programmes. 

Some  programmes  have  made  the  media  an  intergrated  part  of  the 
programme.    Others  feel  that  it  is  a  peripheral  thing  -  a  form  of  "icing  on  the 
cake';    A  clear  policy  has  not  been  established  Hn  this  matter  at  the  present 
time. 

ROLE  OF  USE  OF  REGIONAL  CENTRES: 

This  particular  aspect  of  the  Open  University  has  not  really 
been  fully  evaluated.    It  is  estimated  that  50%  of  the  students  make  use  of 
regional  centres.    Those  who  make  use  of  the  centres  are  those  who  need 
assistance  in  their  programmes  or  those  who  have  a  feeling  of  need  to  be 

involved  in  the    community  .    Tbose  who|use  the  centres  are  those  who  are  doing 
well 'academically  or  those  who  live  in  isolated  regions  of  the  country. 

The  regional  centres  are  used  for  tutorial  purposes  and  also  for 
group  meetings.    They  may    Iso  be  used  for  study  purposes  because  they  contain 
collections  of  materials  from  courses. 

SUMMER  SEMINARS: 

The  in-house  sessions  are  held  each  year  during  the  summer.  The 
opportunity  for  students  to  gather  together  and  meet  with  the  academic  staff  and 
become  involved  in  intensive  study  sessions  has  proved  to  be  a  most  valuable  part 
^  of  the  curriculum.    Seminars  vary  in  length  from  one  to  three  weeks. 
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The  information  which  I  have  is  quite  unofficial.    It  is  based 
on  approximations  worked  out  by  members  of  the  staff  on  the  projected  budget 
for  1973.    The  suggestion  is  that  this  might  be  in  the  neighbourhood  of      10  million 
for  recurrent  costs.    Expenditures  will  include:    direct  student  costs,  includ- 
ing tuition  and  counselling  -  12%;  printing  of  material  -  5%;  home  study  kits  - 
5%;  postage  -  2%;  audio  visual  aids  -  less  than  1%;  salaries  -  20%;  B.B.C.  - 
20%;  regional  offices  -  17%;  administration  14%;  Institution  of  Education 
Technology  -  135%;  Department  of  Staff  and  Student  Affairs  -  less  than  1%. 

The  fees  provide  10%  of  this  total.    Government  grants  make  up 
the  remainder  of  the  funds.    Student  fees  vary  from|l5  -^25  pe.-  course  with 
•t  30  -5 35  added  per  week  of  summer  school  attendance.    The  cost  of  text  books 
in  any  given  course  is  limited  toi^lA. 

This  indicates  to  me  that  the  cost  for  a  course  to  an  individual 
student  could  be  quite  high  -  perhaps  even  prohibitive  to  certain  groups  in 
British  society.    It  is  interesting  to  note  that  the  total  budget  for  salaries 
is  50%  higher  than  the  total  cost  of  administration  and  represents  1/5  of  the 
total  recurrent  costs  of  the  institution.    Most  universities  in  Britain  use  one 
half  of  recurrent  budget  to  pay  salaries. 

CONCLUSIONS;  ^ 

It  is  difficult  to  say  very  much  about  the  institution  with 
limited  information.    It  must  be  obvious  that  the  expectations  of  its  founders 
have  not  in  fact  been  realized  and  that  pressures  from  external  and  internal  ' 
forces  have  moved  it  away  from  serving  the  communities  which  it  was  originally 
intended  to  serve.    One  may  or  may  not  feel  that  original  expectations  were 
realistic.    Yet  there  really  has  not  been  an  attempt  in  Britain  to  open  the 
university  system  to  certain  groups  in  society. 
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We  in  other  countries  must  of  course  be  careful  about  the 
conclusions  which  we  draw  concerning  the  adaptability  of  these  programmes  to 
other  settings.    It  is  my  suggestion  that  we  have  much  to  learn  in  the  Open 
University  from  both  its  successes  and  failures.    They  have  been  successful 
in  the  attempt  to  establish  a  national  institution  using  both  media  and 
correspondence  as  well  as  residential  and  study  sessions  in  an  integrated 
learning  programme.    We  should  therefore  .attempt  to  study  what  they  have  done 
for  it  will  assist  us  in  our  attempts  to  develop  media  assisted  learning 
activities  for  a  wide  population  base. 
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TRAINING  AS  AN  UNOBTRUSIVE  MEASURE  IN  ADULT  EDUCATION  RESEARQI 


Adult  education  researchers  share  the  concern  of  other  social  scientists 
for  finding  non-reactive  measures—those  which  may  reduce  error  due  to  reactive 
measurement  effects  and  to  single  measurement  of  the  same  phenomenon.    The  use 
of  training  as  a  means  to  gain  access  to  data  relatively  uncontamlnated  by  such 
error  as  interviewer  effect  and  awareness  of  being  tested  may  be  especially 
appropriate  for  the  adult  educator/researcher  who  has  a  strong  practitioner 
orientation.    The  opportunity  to  combine  practice  skills  with  a  research  focus 
may  not  only  be  highly  appealing,  but  may  provide  a  legitimate  context  in  which 
to  observe  otherwise  inaccessible  behaviors. 

Webb,  Campbell,  Schv/artz,  and  Sechrest'*-  point  to  the  use  of  ^"outcroppings" 
as  unobtrusive  measures.    This  paper  focuses  on  the  outcroppings^-^albeit  con- 
trived outcroppings — available  in  a  particular  action  research  project  through 
training  conducted  by  the  project  staff.    The  project  involved  a  university, 
community  college,  and  more  than  thirty  community  agencies  working  together  to 
develop  and  evaluate  a  two-year  degree  program  for  upgrading  paraprofessionals 
employed  in  human  services. 2 

In  order  to  carry  out  this  overall  objective  a  number  of  research  purposes 
were  involved,  including: 

the  identification  of  needs  for  training  of  agencies,  administrators, 
supervisors  of  paraprofessionals,  and  paraprofessionals,  and  the  inter- 
relationships of  these  needs; 

-  a  description  of  the  context  in  which  these  needs  occurred,  including 
the  rewards  available  to  paraprof essional  and  professional  staff  and 
the  contingencies  under  which  rewards  were  made  available; 

-  the  identification  of  payoffs  and  tradeoffs  involved  in  inter-organi- 
zational relationships,  and  the  commitment  of  participating  organiza- 
tions to  the  overall  consortium  effort;  and 

-  the  identification  of  value  standards  for  evaluating  paraprof essional 
performance. 

A  major  effort  of  the  project  was  an  intensive  interview  survey  of  agency  and 
school  administrators,  supervising  professionals,  and  paraprofessionals.  Sur- 
vey methods,  however,  are  liable  to  the  reactive  effects  mentioned  above.  An 
additional  means  or  getting  at  the  information  needed  was  provided  through  a 
variety  of  training  events. 

Before  describing  the  particular  uses  of  training  as  an  unobtrusive  mea- 
sure, two  things  are  worthy  of  note.    One  was  the  fact  that  the  project  staff 
included  more  than  one  person  trained  in  adult  education  skills.    The  use  of 
a  team  of  trainers  permitted  multiple  observations  of  each  training  event  and 
therefore  a  check  on  observer  reliability  not  available  in  single-observer 
analysis.    Second,  each  training  event  was  occasioned  by  a  program  development 
aspect  of  the  total  project.    It  would  hardly  have  been  *  unobtrusive'  to  have 
introduced  training  simply  as  a  means  of  gaining  multiple  data  inputs.  The 
treatment  aspect  of  each  training  event,  while  not  claimed  to  be  non-contami- 
nating, was  believed  by  the  investigators  to  have  been  minimally  reactive  for 
the  research  purpose  described  because  of  the  other  legitimate  objectives  the 
training  was  designed  to  meet. 
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Contributions  of  traluLng  to  the  rosearch 

A.  One  of  the  concerns  of  the  project  staff  was  the  e^;cen;*  to  rhicp  tlic-  van'oi'ij 
schools  and  agencies  einplo}?ing  paras  were  coiu-T.itted  to  the  censor Liinn  effort  to 
provide  educational  development  for  their  paraprof essioual  staffs,    UhLJ.c  a  sur- 
vey of  the  employers^  revealed  that  paraprof essional  staffing  was  on  the  int.rense 
and  agencies  recognized  a  need  for  in-service  training,  the  readiness  lo  commit 
resources  to  the  development  process  had  not  been  tested*    As  an  addcu  r:easure 

of  agency  willingness  to  enter  into  inter-organizational  relationships  regarding 
paraprofessionals,  records  were  1^'^pt  of  attendance  by  agency  representatives  at 
several  events.    One  sel  of  these'  events  was  a  series  of  programs  on  aide  func- 
tions and  emplo3mient  sponsored  by  a  section  of  the  country's  Social  Pia^^ning 
Council,  to  wiiich  all  public  and- private  non-profit  human  service  organizations 
were  invited.    A  second  set  of  events  was  sponsored  by  the  project  staff  specif- 
ically to  feed  back  information  from  the  surveys  and  get  a  'sense  of  the  meeting* 
regarding  the  development  process.    Neither  set  of  events  '  :ul  a  high  mand  quali- 
ty; both  were  held  during  the  daytime  so  that  agencies  Iia  '  lo  release  the  time 
of  their  staff  to  attend.    Ifliile  the  content  of  these  nieeti       was  important  to 
the  project's  program  objectives,  the  representation  pattern  aud  consistency  of 
attendance  was  an  observable  inter- organizational  behavior  that  supplemented  the 
expressious  of  interest  gathered  in  the  earlier  interviews  with  individual  agen- 
cies as  evidence  of  commitment  to  the  cooperative  effort. 

B.  During  the  latter  part  of  the  first  ye^ir,  it  became  ijapor^^ant  to  try  some  of 
the  notions  regarding  the  generic  nature  of  human  service  training*^  \<r±th  a  cross- 
section  of  paraprof essionals  from  .each  of  the  counties  involved.    For  this  pur- 
pose a  pilot  series  of  training  sessions  was  designed  m  each  county.    The  ses- 
sions were  held  during  the  day,  with  cinnouncements  mailed  to  all  school  and  agen- 
agency  direcotrs.    Participation  in  the  pilot  sessions^  it  was  believed,  would 

be  a  function  of  the  folloX'?ing  factors: 

-  the  interest  of  individual  paraprof essionals  in  engaging  in  this 
form  of  training; 

-  the  motivational  quality  of  the  training  offered,  particularly  as 
it  affected  continuing  participation; 

-  the  willingness  of  administrators  to  bring  this  opportunity  to  the 
attention  of  their  paraprofessioual  staff; 

-  the  willingPiss  of  schools  and  agencies  to  release  ,  ••r'>pi'of'=^s9ionals 
from  work  to  attend  the  sessions. 

The  two  latter  factors  were  the  basis  for  using  attendance  of  paras  at  project- 
sponsored  training  events  as  a  supplementaJ  Indicator  of  organizational  conimit- 
ment  to  paraprofessional  development. 

C.  One  of  the  problems  mentioned  by  aides  and  professionals  in  the  interview 
survey  was  the  quality  of  supervision  provided  for  paras.    The  basis  for  super- 
vision problems  was  not  entirely  clear;  it  was  suggested  that  lack  of  supervisory 
training  in  the  professionals*  background,  apprehension  regarding  the  encroach- 
ment of  paras  on  professional  territory,  and  incongruency  of  delegated  respon- 
sibility vnLth  the  norm  of  professional  autonomy  might  be  contributing  factors. 

In  any  case,  the  administrative  level  had  approved  the  development  of  training 
for  supervisors,  and  the  stipervisory  level  had  paid  lip-servxce  to  the  desir- 
ability  of  such  training. 
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Two  series  of  training  events  centering  on  the  acou:!:      oi:  supervisory 
skiJ.is  werc>  heid«    One  was  designed  for  selected  staff  >      <^c]^,r^ol  dis- 

trict, to  clieck  out  the  prevalence  and  nature  of  supervi^^o.        .yl  iu  s  within 
the  schooL  setting.    Since  attendance  was  more  or  less  cov.ry:,..  -y,  this  was  not 
considerea  to  be  a  non-reactive  measure.     (The  contenc  of  t\n   .  or^cslicpp  «  devel-- 
oped  from  the  participants'  inputs,  was  also  recognized  to  be  subject  to  cer- 
tain mand  qualities  of  the  situauion,  although  it  sensitized  both  participants 
and  project  staff  to  the  variety  of  suT>er^/isor'-aide  relationships  within  tho 
school.) 

The  second  series  was  open  to  professionals  in  aJ 1  schools  and  agencies 
in  the  two  counties.    Each  of  the  five  workshops  held  was  a  day-long  event, 
requiring  participants  to  malce  appropriate  advance  arrangements  fcr  their  absence 
from  work.    Miile  administrators  might  have  withheld  approval  of  participation 
in  any  workshop,  there  x^as  no  evidence  that  any  agency  or  school  required  any 
of  its  professional  staff  to  attend  nor  offered  *Bx"ox<mie  points*  for  voluntary 
attendance.    Therefore,  even  though  the  events  were  contrived  in  response  to  a 
perceived  need,  participation  was  voluntary  and  could  be  used,  it  was  believed, 
as  an  unobtrisive  measure  of  supervisor  coiranitment  to  continued  personal  growth 
and  to  responsibility  for  facilitating  supervisee  role  acquisition* 

D.    Each  of  the  workshops  was  designed  \7ith  particular  objectives  in  mind,  most 
of  T^iich  i^exe  explicitly  related  to  the  development  of  supen/isory  skills-^ 
During  a  part  of  one  session  the  participants  x^ere  requested  to  serve  as  consul- 
tants to  the  project  £;taff .    An  exercise  in  which  supervisors  Identified  factors 
that  hindered  or  facilitated  their  o\m  role  acquisition  an'  performance  and  then 
compared  their  lists  with  items  previously  identified  by        .].rof essionals  led 
to  recognition  and  discussion  of  the  '^full^'-f auctioning  team  uomber.'*    At  this 
point  the  participants  were  asked  to  describe  the  characteristics  of  such  a  per- 
son if  employed  as  a  para  in  their  ovm  organizations.    Through  a  pooling  process 
the  responses  were  coJlected,  assessed,  revised,  and  finally  accepted  as  a  con-- 
sensus  definition  of  the  aide  behaviors  that  supervising  professionals  wanted 
the  coiimiunity  college  to  help  them  develop. 

This  infomiation,  developed  and  validated  through  a  consensual  process  in- 
volving representatives  from  all  of  the  types  of  agencies  erapJoying  paraprofes- 
sionals  in  the  area,  became  the  content  of  a  scale  for  employers  to  rate  super- 
visee role  performance.  Following  f ield-testixig  and  reliability  checks,  the 
resulting  rating  scale  (attached)  was  made  available  to  employers  and  was  used 
in  project  evaluation.  Claims  for  the  validity  of  the  instrument  were  based  on 
the  nature  of  the  process  through  which  the  content  was  developed. 

The  nature  of  supervisor-supervisee  interaction  betX\Teen  professionals  and 
paraprofessionals  has  been  discussed  in  much  of  the  l^e^i  Careers  literature.^ 
It  was  unclear  to  the  project  staff  to  what  extent  that  material,  a  great  deal 
of  which  examines  new  roles  in  urban  settings,  was  applicable  to  the  upstate 
non-urban  community  in  which  aide  roles  took  several,  often  traditional,  forms. 
Without  biasing  participants  in  the  training  workshops  by  reviewing  the  insights 
of  'experts^  in  the  field,  the  sessions  were  designed  to  permit  the  participants' 
own.  expertise,  gained  through  experience,  to  surface.    By  ^Mrious  forms  of  role 
play — in  dyad,  triad,  small  group,  and  large  group  setting:;,    './ith  a  varif  y  of 
means  for  recording  the  salient  features  of  the  interaction  as  well  as  the  inter- 
pretations and  alternative  role  analyses  of  non-role  playing  participants  in  the 
workshops,  the  researcher/ trainers  gained  a  great  deal  of  information  about  the 
relationship  of  professional  to  paraprofessional.    Much  of  this  was  conceptualized 
^  during  the  workshop  by  the  participants,  much  like  Kozoll's  technique  in  train- 
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ing  executive  secretaries*'^    This  use  of  trainin;|  to  conceptualize  an  area  In 
which  there  is  a  limited  body  of  knowledge  anc  little  if  any  previous  research 
was  probably  the  most  exciting  aspect  of  the  project*     (For  a  sample  of  mate- 
rial produced  by  a  workshop,  see  report  to  participants  attached.)  Obviously 
it  does  not  fit  the  paradigm  of  non-reactive  measure  advocated  in  the  pre- 
viously described  uses  of  training.    It  does,  however,  provide  a  legitimate 
context  within  which  the  researcher/trainer  can  apprehend  otherwise  inacces- 
sible behaviors.    These  data  serve  to  supplement  information  gained  from  a  re- 
view of  literature,  interviews  with  key  informants,  and/or  on-site  observations. 
The  latter  two  are  particularly  vulnerable  to  interviewer/observer  effect.  In 
the  training  setting  the  trainer  role  may  mask  the  research  role.    In  addition, 
the  participants  may  be  more  influenced  by  the  intrinsic  interest  of  the  con- 
tent they  are  generating  and  by  the  interest  of  their  co-participants  tlian  by 
an  observer  effect  generated  by  the  trainer. 

Conclusion 

BaBe4  on  experience  with  this  project,  the  use  of  training  as  a  means  of 
gathering  data  that  are  relatively  uncontaminated  by  observation  and  that  can 
serve  as  part  of  a  multiple  measure  research  strategy  would  appear  to  be  effica- 
cious*   It  is  appropriate  when  the  nature  of  the  research  project  calls  for  or 
permits  ono  or  more  forms  of  training  as  a  program  component — probably,  there- 
fore, more  suitable  in  action  research  projects.    It  utilizes  skills  which  are 
frequently  a  part  of  the  adult  education  researcher ^s  repertoire;  its  reliabil- 
ity is  enhanced  by  the  presence  of  two  or  more  trainers  working  as  a  team. 
Perhaps  the  greatest  significance  of  this  experince  to  the  project  staff  in- 
volved was  the  recognition  of  the  tremendous  potential  available  in  an  activity 
which  would  otherwise  have  been  regarded  as  a  necessary  but  onerous  responsi- 
bility. 
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Attachments; 

1)  Rating  Sheet  for  ihraluating  Aide  Performance 

2)  Report  to  pariticipants:    Workshop  III 


From:     ToaP  Kri^^iit^  iluiiaii  'Service  Training;  Project 


Ws  arc-  enc  Losi:\i^,:    i)  r  copy  of  the  sch(?ciule  fey.  th.^  v       ;    ;  .        a  smmnary 
of  that  day'ii  net  :.vit:i(-s .  aii-l  3)  a  roster  of  j/ort j cipmts ,    '^d-  '\-..vi.iary''  is 
just  a  ohoiice  "'or  us  to  note  -jouie  oi  chi;  T7Uii:\  pol.M:s  wo       -i  •.icr>/.»:i  from  full 
day  of  nci.ivicy  and  c!i\CusrAo:i  :     yoi  vx\y  '.:c,ul  !:o  ar.eud  liios;*'  !;>  jJdlujr  3oue 
pciniis  of  your  own. 
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Since  it  began  uvo  ytiai:s  ap,o,  the  Hu-.-c^ri  Seivlc.^  Train jn^^.  Pro j eel  !ka.'<  included 
among  ii.^:,  -:o:rponf;iit  tasks  chaL  of  provi(iin<,  continu:.u;^  »>ducat:ion  for  the  prof^fj- 
siouais  \7hu  iu-vt.rvLse  par?  piL'orc\Si.ionais  ir.  varioufj  ln^ur.au  t;e.:vice  agencies  ii^  Cnnt- 
land  zir.d  j.o.ipk"i.a3  Cf'vr.Lit-s.     ll:  is  foj.L  tiiat  ,->upcr\^iso::s  yhcul.::  be  awar<:i  of  ail 
aspects  of  ch::'  Co^.vti:Vu L^y  Coiiegc^s  ovn  titforts  fo  pv-o\'"'^de  t:rajnln^;  for  aides,  and 
should  ha':e  nic.:".ii::uji  opr.ortuniLy  to  participate  in  th'-  dosigxtj  development  -  impie- 
iueritav:iou,  and  evaluatior;  of  tK-c  ei.ut-rgiuj^  Human  T^^ervice'  Program.!  at  Tompkins-Cort- 
land  Coawiunitv  College. 

.:oiiCiriuiiv;  ^ulucacion  for  prof ej:;ionaia  Ls  based  upon  an  a^sumpt jcn  of  pro- 
fei;fiion'il  door'iiau''.;  li-  tlie  hi/i-a-i  service?;,     in  inoyL  aj^L./.cje.s  professionals  detc»r- 
mine  policy  rega^\*inj>  UlrlPi^.  t5:aLnlng^  nnd  career  AKivt  U.rvr.cuL;  Jikevnse  they 
iiicerpret.,  translate,  ar.d  pa;>:^  oiong  such  po.li*.-ies  i.o  ih'    r]^tj<=>r,  netting  the  tone 
in  the  day  to  day  woric  envlronn>;-nt. 

In  partictilar  8api^rvi:^ors  play  a  big  part  in  defjni'\;         role':  ot  aides, 
by  developia^^  job  dt^fu'riplions a-^ssignlag  tai>k3,  and  \:ii^r/l\\f^     .c  evaluation. 
i\iid        they  defL?.^'  aide  roi-i^;^, ,  so  al^jo  cire  their.  ov;u  iT.ojcS  r.ltoi.^d  and  re--defined 
at  the  same  time.    The  receipt  workshop  \7cs  /^u  yf::crt        .explore  the  complemen- 
tarity of  this  )*olc  defi:\ition  process  by  hriap.iii^  tor;et:her  professionals  and 
paraprof es^ioiials  froni  a  'iiuiJ:v^jc  or  orgarJ  rial*  i..n:Sr 

SUI-g-)A?lY  OF  THE  WOl^SHOP 

Duties,:  What  Can  SiiparvLsors  ^Expect  of  Aides? 

The  Eiornins  session  wat;  devoted  to  those  aspects  of  the  ajde-siipei-visor  re- 
lationship in  -..Mch  Che  supervisor  initiates:  activities  that  shape  the  aide  role- 
liSTr  cjtaff  presanted  the  notion  of    'dv;ties  and  ri^jhts''  as  a  backdrop  for  discus- 
siofu    Three  basic  models  for  utiiirjing  aides  v;ere  presented .  and  it  was  suggested 
diat  each  one  serves  to  d^fine  aide  duties  in  a  diffc-rent  vay.    The  first  portrays 
aides  perfomang  low  level  tasks  to  free  the  professional  to  carry  out  tasks  for 
which  he  has  been  trained.    Its  p,oal  is  to  Increase  the  amount  of  service,  but  not 
9/^"  necessarily  to  chauge  content  of  that  service. 


.l^iWt'^  oi  ill'.  \-viousiy  *' 


2  c^M:.  >  r.cv  • 


..  'K  -ic\\hi  Its 


job  d  -f '.n^  t:io':.:  s...\"'  :i  *  v -ojct:*.  usv;:    i    '.  ■ 

"lathe-:  thcjzi  *i"Ld'c  cluLies  uo  job  duscr:LpLi;>iv.^ . 


i  r 


1. 


\ 


.     /     \     \  / 


/Aid:-  Ta:>Ks\ 

/.-  I 


/ 


\ 


I 


Til. 


/  \ 


r  "  rof  essiona.ls  and 


Prof '.t J :Ioud  1  |  ^  ^^jV^iL.)    /  —  \ 

1  /      onJ  " 


joD  dcf^:cripi:icu:;/ta^*k  o::30i"Vc.'.Liofi=:  they  had  >rou^lii:.     f>c-\'e       j^^ii'orai l:'.ai:iop.r. 
seemed  Co  euerge:    Moi^L  model  i  aifies  iiw.'e  no  fortnaA  :]cb  dcncript;*i.cus.    Many  aii-.o 
are  juf ervi^ieci  by  i;evorai  persons.    Aidas  In  l.'!cse  nor;li:ions  hav?  hif^h  autonomy 
In  that  tati'-^s  :iTe  ''givoii  ov-er*'  to  tir.oiii.    '•'h?la  a-..tor.OTny  is  maintained  in 

soite  of  very  ciosu  propiaqull-.y  l-i*..        i;.  po^:slbl.^  lo  be  vary  close  to  the  aide 
all  dav  and  not  really  luiov;  ^'har.  r^ne  is  doinj?.     ilil:^  nicdoL  o:chxblts  flexibility 
in  ths  aide  rolc>,  but  cau  also  r-^^iuit  iu  rrijsimder;>tr;iir.in-,c.     Aide  taski;  are  rou- 
tiniiied:  supcrvir;or  attoi-Cioa  is  ^:lsovo^^re, 

Few  Gxaxplor-?  of  nouel  2  fjoerued  rep:-;osenz:c:d  amonj,  pare  J  c  Li^uit.^ .    There  seems 
little  shai ing  of  tas^^^s  within  tlui  prox'^i:sioaai  donia.in,  e:  cepL  \;rioi  aide  slots 
arc  filled  by  :jr'*i^profossionals  (collej^e  stadenri^j  etc/'    -  '^y  piof o$:sionals 
operating  at  a  level  lover  than  their  prepa-'ation  would  '  J.v.*  oxccj^tion 

is  in  the  uead  Start  program,  where  teacb.eri^  and  aides  v>  .'iuv^  '"ange  of  tasks. 


dasc.riP*  io::s  ?l     r,    '  r  a,t./.'     '    ,i  j ..     , :    ;    '      .      .  "     '      ,     .  '   '  r 

of  cl::.  fL^iviitr-'  C:>c''-'  :i>:v    o  tn^r».*ijn.t,  l*.' *  ^  *      ,  .'.if, 

sectmed  lo  i^?';)   '.u  .'^.o'yi  jlIu?,  j.ices  i.:.  cai/Vc  -.iul    "\'r      ;  -  •  .  Ms- 

tance  is  a  rciri  i;:v.:i^  •  ^or  uUc-  :;up  .-rv  i  jor .     >if  '       .*  alf";.*       .    >  r.v   ^  ^ -jb^' :';l:'i<\ 

can  creates  criurr  -ii/f  IcuJ  d  c:>  (iiivo  J     po.m.  In  ^IJ..;'  i^^rr      '  - 

There  scomi^  to        rcn^-  a.i:»l>i:,aity  ?.c  uo    ^  '"'"i  It:  in  y::.7.:  I      .'Iv  co 

perforin  aii  Cdsk;'  ^'h.:  r.iiU  n:usi  perfo^rm.        v'!;eihcv:  i;  'J-.  i        .inr  c<»  Jruar- 

felt:  thai"  r.he  s-^pcrvioor  tiiv  Ti."-'..  of  iosin;;  tc-M^i  .  I'.i.  '  'v.j.^  '*  ^  in  c^i* 
fieJd/'  • 

feie  t:iils  A'i.li.           a^cur..  ••■-IIJ            .ii  ii^i-^a-:-.  0;j          i  >  l-.          .^^  U-f 
aides  tihrcMi^ihcuL  '...<  Iji'^-nn 


"reciT-rocity. "    'r!i;.y  c-uiriiiuj;  U,ed  tlrM.  the  eiaborai  Ion  o?  r.'.-.lo  JuUi:--:  i;.jpJ:',is  uhat 
aides  .^iay  an  _  :u:>urlaat  p.ivc  In  Ciu-  op-jrnti.on  c»f  th-.-  OT^ic^niy zt  iol^s  that  eiApioy 
the:;:,     .uid  tJiii>  f.aol  esC^^.l llohcii.  c  -  .i.  uhc.    -  jrscrac;;   )/  :iid;.»«  vr!  e.^;  lefilimare 
deraand.-;       supc/viscrs -    :]Sfr    ir!uiiij.:.s  riif.'.ardi  \e  v -at:  aide?  '.r..  ^ct:  of  ::heir  supor- 
vir?crs  ihi^  been  vc-vy  gci:^-raJ .    Iht-i;;  iindlnge  ^iCiV^-  confim^ru  ho"-n  vcr  that  the 
supervisor  \s  rrob^^bi/  \i^c  iiiost.  rr.oo;:ia:tt  pir:;ui:  in  ciie  '/o:;'.  '\^\  of  r.\e  aide. 
The      f  Tnooij'jr.  t:oysir.*i  th..n  va:>  lo  [>\:^a   .ov.-ix^d  :.  b.^^^i-rti  un^c  vst.-Mding  of  wijat 
aidec  expect.     -Hvor    ^.-r?:  incJudoc'  -hs  j;;ir>- U:5.r.\zr.Uv  t.>  a:i/;ifit  in  '-ix^  of  fort* 

mencc',  for  ivr  ''  ::'j;a*r.rt  c.lo.se  per  :i  .ai  ro.lt:t  io)*shJp3  wi  ch  -  :  ..  i\>n£ens':.s 

soOTiod  to  be  rear'..^'        c'.iO  l.ssuo  of  "-^j.  vcaJ.  iu^.  one-'-;  se'*  ■'  .e-:      UiVcU  the 

aido  has  i-XiC-vled:'/   v^l  ri.:;  >;\u>.^rvi.;or  :^  >  c  iJ^'rron  (vui:i.'V.:M  '  "         l.^  *  ai')  she 
iQ  ilahia  to  be;  t-iiv i:i *'t  i .;*.  or  i''t:jn."io-j»t'-od.    (  no  aldv*  r,.:i'.:  .sut-    *.    j.'/J  Lo  to  per- 
form ef  :>.'Ct  lv*i!;/  v/liii  iic  c  supt^/vi  j;or  UT»r»:*    ;hf  '^a.--  ti.c  «':.:  -ci  vi. ::  •   'a  liU^Ttan 
beln*;,  iautaad  ox  sonooax*  It:  a  jn'lvate  .jfl"u*c-  ) 

A::^'ji£!7in^i;  tlier^vi  ^-iiris  requit^**.-^  i-xp/icic  ^;:for::     ^ov;arc  opLrv.t, '.)j^u:  i%ati'ja 
within  an  ortjarii  .^at i.o:, .    'i  he:%'n  o.. '^erts  i*:cludo: 

i.     yettip.j.;  r.f^ido  Sjv^cLal  turivS  for  oru-.i-it :  >  :-.o 
goal;:  oi*  the  ort^i.r.i?c::cic  n,  ar/i  for  •re-'a-^:.risinr^,  the  go.:!:^ 
of  the  orii^ciniajatlon  iu  t*^/ci  iigi^t  of  ciies*  oi)sfervariouo ; 

Gtatinjj  role:5  in  vrltin.'j;  ^.'henovex  poss^bit?,  snd  uod^Xini] 
tiieso  documents  r^iguiarly; 

3.    settln;^,  aside  regular  blocks  of  tliae  for  joint  piaiining 
vith  aides;  aiid 


ERIC 


4.    going  into  the  field  vjith  aides  periodically- 


tfvke  '  \'i  '.C'^ivci  iK^"  I  it:  '   '"-^  ' .   .    >  .ii  .  "    ^  :   '  r-. 

that  crecio:ai<:U-^^',  .^h.^JJ   ^(^^  ho  a  f.r:  ..l-^'..     ;  ^.^  .      ...   .'vit.  i^;i^;etj 

pay  Jcils'-'-s  ^or  ::r:/!o£:)lcn-^  l::.  j 

Sof.c  pariiiv ipj-iits  r*cuec  Lh^  c:-..so       r'^cc:<     t/-  7;.^  t  '   .   •  *      •       '^.  ^'uc^n  funds 
froi*i  ot_t:er  or\;'^:r.ly.Cillvn'6 ,     Ir.tist-  per:/):-:;  hs-vc  r.^'.ii^-,    ^^  .  ■  :     -.>:ul<ir.ly  i^-. 

the  cs^>L.  of  .13? verji::3,  >;t:iiclr>:  i:n  in  Lh^.Lr  -"i^'lci       -^-•L;^:.^:^  •       :  :^c'ni z:si.ioi\ 

must  .a-JjucL  tr  tfu^.Ti  icCaer  lliau  Lhe  ctr.^r  ^vr^  r.j.;.  .rc  .     ^c-.'.;   ^  j-^.  r-r.i::ar.ioas 

of  tor.  ."ace  -he  «*^.  si . '^.r.rio'i.     ilv;  'w?:oir  cr.^* :  •  ^r.  *y         •*  ^  ?  '  pc^jiorai&i'* 

more  o::Cc'r>  t'.ian  chay  c/.r-zt:e  "c^Of^ir J.^iis . " 

courG-s  ct  TC3.     Tr.  vao  aj^r^^oc  ^i-.X  l.r.voJ.'-ei.v'ini:        ^-j         o/.  '       .  oxp^rcUo'cjons 
aii  around.         >ci::*/i9;o'i;s  ex>3C':  •  v'-ct      'jevricvrrar^c m  .       3         tl*  ro.5\:-^n- 
3iI:;iJ.iLy/hi:cI;er  t  'v- .     .Che  ^MIlVAi-  k::ovic  i^e  :^       'r.'-x-^.^^x^t    ,  c^,:'   r"\  ijos.:-  s^eits 
to  f.i.<icl^::'ii.c  \-:Lzh  lL?  la^or  :r^:ir?-^^^ f ,     Jil^c;,  .  ur:>Ius  ?     lo.^a can 

an  in-.:rcajc;:l  t'iro-.ii:  ::o  psirrn/oxc-r-  :;.r.i:a.'.s  vhen   VorU':/'  *:ec  •••.or.  „';i.jtc'j  ''ec-— 
cation  J' 

\t  ;v.«..j  felu  cha;.  :  <:Cii'Jic)e  aide's  roifto  are  cniy  :.u  tri'.^  i-rocosi;  of  developing, 
their  decis.ion-r.inkin.'^  r^-spon.slMl:- ty  pj.:icos  .^.a:.-^:c  re.*Bp.O;is      .lir  Les  01:  their 
supervisors*    That  io,  aidos  are  jcn:"r/)ncfid  by  c;itua?:ions  calii.ig  for  decision 
r>j5ien  lic  p:•oceJ^?n•-  i:;  a^  hand.,    Ther^l'd^  Lbey  uced  co  b;^  bac-i'iid  up  in  their 
decisions-    t'cvtzovPu^  Uhey  couJ.ci  h'-J..p  in  anaiyv:inf.  d.-^cidion^  for  generaii^abiiity . 
and  they  need  as'slot^ncd-  in  ant:'v:ipacli';^\  futurv   >cisioa  sitaAi:lo-.;s- 

A3.r.oc::  aJi  of  do  "rigl  ts*  of  aioer  couid  -j:^  £>i-.iriGd  'ly  '.•  ch;*  i'olio-.-ring 
thr^ie  aLLiibate*:  of  ar.  effective  :;,.per' Lsor  • 

.U    accc.?.:,  ."^i  L.Lcy  co  i;u*;er  /5  sec-s 

2^     c/irt^bxl:  ty  fur  J.-'.^tt^niJi;: 

3.     ^^tiiPvi/c-  ap:j::<.:ciau        fr^r  Lh:=^  \-r.*-\    'Cl  .•r;^ 

Arid  it  >eeiied  a^ro^/d  IhiL  vh«^  r>c  ai  i  r  *  .i-'.  ^*   r.  L"^  »:i-jr,^j  frcr     ,  r . '  ;Let.u  irf:*orts 
in  tlvi  part  of  aida  a-ad  ..a^.jJvLa  r  aii:..-  Lc  1  z\  -  l-^  iiar^y.  j.  .    ''hu:  ^rreat^r.c  ^.'orkshop 
raised  further  l.:.:;r.Oi,  for  ro..i>iac'r.;L  L-;r. .     UiL-rre        jioii?  r.i^^hv  attack  such 
issuos  as:    j.*  uo;.  to  brerk  <*o\m  trviaer  J        lour:  /.  'O      c:».  *'r;>ci::v.* vOrv  ^'inction, 
2)  ho\'  to  expiora  ti;e  natvre  of  ':ri.st  1.^  -t.*-^^  ^r:       terrace io.i.  and  3)  hov7  to 

eiaborct'-  a  F..-^t)iod  for  prcjidini^  ^Miiiii  i:-Liy  ui:!>re:.i  job  d.^scriptionc .  so  that 
aides  h.ivc>  a  rcilcvant  -/aru-sti for  saif -'.-vaiuation. 


ERLC 


CO 

P 
c+ 
0 

O 


9 

H 


s: 
IB 


p 
fr*  o 
<  H 
CD  H 
►1  fD 

to  a 

H-  fD  O 

4o  Hi 

V  fD 

ct  fD 
fD 


p 


CO 

& 

fD 

a 
< 

(D 


O 


to 
f) 
o 

H 

.  o 


O  O  M 

JH  l-l> 

c+ 5 

?  ^  Q 

fD  d-  C 

2  §  E 

O  P 

O  H 

C  fD 

09 

fD  c+ 

*t  O 
< 
fD 


P 

fD 

p 

c+  p 

Z  p 

5 


a* 

fD 


O  H- 
H-  P 

sr  ^ 

fD  c+ 

^  & 
P  {D 

O 
fD 

o 

Ct  CD 

5*  ^ 

fD 

»1  O 

O  H. 

0  fD 

cl-  U 


^ 

Q 

o 

d- 

o 

fD 

CO 

fD 

H- 

:3 

c+ 

fD 

tr 

g 

C 

fD 

? 

o 

B 

:5 

vn 

tr 

ct 

fD 

O 

H 

s* 

p 

P 

th 

8 

fD 

a 

*% 

fD 

fD 

:3 

O 

•o 

O 

O 

0* 

CO 

B 

fD 

5 

CO 

o 

H 

CO 

fD 

*<{ 

d- 

O 

c+ 

tr 

fD 

o* 

fD 

% 

O 

*1 

O 

to 

? 

P 

H 

P« 

H 

c+ 

H* 

fj 

fD 

H« 

fD 

CO 

o 

H« 

P 

»d 

ct 

ct 

H« 

H- 

O 

O 

ti 

:s 

P 

p 

d- 

o 

►1 

d- 

o 

O 

CD 

CO 

O 

fD 

P 

O 

tr 

p 

(?) 

Q 

fD 

3 

O 
d- 
H« 
O 

CO 


o 

i 

m 

fD 

H 

CO 

o 
►1 


d- 
O 


ft 


I 

OQ 

p 

p. 

P 
d- 
H- 
O 


5^4 

i 

fD 

1 

fD 

O 

O 

P 

P 

H* 

d- 

O* 

H- 

fD 

d- 

t 

O 

CO 

C 

fD 

fD 

at 

CO 

fD 

o 

0* 

Su 

5: 

0* 

fD 

fD 

oT 

CO 

d- 

H- 

\ 

d- 

to 

CD 

d- 

l" 

H- 

d- 

H 

fD 
•  • 

I 

CD 
I 

H 


d- 

o 
o 

H 
H 
fD 

fD 


fD 

00 
d- 

fD 
O 


I 


o 


ERIC 


ERIC 


§• 

O 

(W 

g 

N 
P 

O 
3 


o 

CO 


O  H 
0)  CO 

p  o 
3  o 
P'  B 
P  •d 
*i  H 

CO  (0 
CO 

o 

cr 


H*  CO 
N  d- 
P  P 


P*  CO 

d-  0  O 

tr  (0  0 

H-  CO  B 

o  d- 

on 

d-  (0 

CO  w  CO 

d- 

P  o  p« 

0  O  o 

CO  ^  p 

o 

d-  O 

cr  d-  g 

(0  cr  S 

O  H- 

►1  B 

P  CO 

1 

d-  ^  CO 

cr  o 

H-  O  O 
(0 

CO   !-»•  d- 

CO  p,  :r 

(0  d-  O 

d-  H* 

O  p 

•  H  P 

d-  I 


d-  p 
3  §  " 

P<  P<  P 
%  P 


d- 
(0 

(0 

I 


(0 
d- 

cr 


o  P 

Hi  O 

o 

d-  O 

cr  ►I 
p 


O 

►1 


P 


O 
d- 


P 

CD 


d- 


o 
p 

H 


CO  to 
d-  p 

P«  o 

CD  O 

O  % 

^  H 

d-  (P 

cr  CD 


O 

p 


d- 

cr 


cr 

M  (P 

d-  (P 
H-  d- 

o  cr 


p. 


(P  w 
d-  p 

cr  CO 


H*  O  CD 

O  m  o 
(p 

CO 

d-  c 

ga 

P*  (P 
p  ►I 

►1  CD 
P*  d- 
CO  p 

o  a* 
p. 

(P  o 

o 
►1 


g 


d- 

cr 
(P 


O  d-  M 

►1  cr  F 

(P  0) 

S  (p  < 

H«  d-  D 

N  cr  r< 

P  H*<< 

d-  o 

P  H 
O   H  H* 
3  d- 
•    CO  d- 
d-  H 
P  (P 

SB. 

►1 

01 

O  ct 


8- 


O 


P 

d- 

H*  d-  cr 

o  cr  p 

3  (P  < 
(P 

CQ  CD 
O 

Pi  S 
CO 


<  p<  CO 

H.  O  O 

d*  (P  0 

cr  CD  (p 


H'  0  cc 

N  p 
P  03 

d-  d- 

H-  cr  p 
o  (P 

^  ^  <^ 
•  0^  cr 

O  O 
P  *i 
H  O 

eg 

cr  p* 
(P  (P 


o 

g 

I 


►1 

CD 
d- 

g 

P« 


d- 


d-  3 

cr  o  _ 

(P  d-  (P 
%»  01 

(P  ^ 
cr  (P 
m  01 
s 
(P 

P 

d-  b  B. 
cr 

(P  p 
o 


o 

p. 

01 
O 


O 

p  p« 


CD 
O 


cc 

0  P 

p.  w 

01  0) 
O 

O  B 
Hi  (P 

d- 

cr  5 
(P 


O  (P 


O 
00 


(P 

0) 
d- 


P  0 

H-  3  (P 

N  O  OJ 
P  (P 


P  P 

^  5 
H-  a* 

P  t3 

d-  CQ 

O  O 
d- 

cr 
(P 


O 


cr  p 
(P  *i 
(P 

O 

»  (P 
cr 
o  p 

(p 

d-  cn 
cr 

(P  H* 

o  ^ 
►1  p 

P  o 

o 

O  (P 
d- 

cr 


0  w 
p 

01 

d- 

cr  < 

0)  (P 

►1 

O 

P  H 
H  H* 

01  d- 
d- 

O  H 
(P 

d" 

cr  5 
(p  a« 


O  ^ 

(?J  d- 

p  p 
p  (3 

d-OQ 

o 


(P 
p 


d-  p 

0  cr 


p 

d-  (P 
(P 


VJT  p 

I 


H« 

H.  ^1 

N 

P 

cr  w 

c*- 

CO 

H« 

CO 

0 

c+ 

CO 

H 

cf 

0 

H-  0 

0 

o 

cr 

ci- 

P 

H  Pi  H« 

ts 

(P 

CO 

H,  H. 

CO 

H. 

H,  3 

H»  to 

O  CO 

cr 

0 

>i 

P 

CO 

g 

c 


UTILIZING  OHIO         LEADERS  AS  SUBJECTS 
FOR  EX3>ERIMENTAL  RESEARCH* 


presented  by 
Richard  E.  Young 
Assistant  Professor 
The  Ohio  State  University 


at  the 

Adult  Education  Research  Conference 
Montreal y  Canada 

April  5,  1973 


I* 


-^^ased  on  the  dissertation,  "The  Effectiveness  of  a  Correspondence 
Course  for  New  U-H  Leaders"  by  the  presenter. 


CONTROLLING  THREATS  TO  VALIDITY 


THREATS 


CONTROL  TECHNIQUES 


"Distrust"  of  Randomization 


External 


Residence  of  leaders  in  sample  counties  compa:*ed  with 
residence  of  members  in  same  counties.    No  significant 
difference. 

Residence  of  leaders  in  sample  counties  compared  with 
residence  of  all  Ohio  U-H  members.    Urban  leaders 
under-represented  in  sample. 

No  county  with  a  large  city  fell  in  sample,  but  only  Ih 
of  Ohio's  88  counties  have  large  cities. 


Internal 


Demographic  data  on  experimental  and  control  group 

respondents  were  compared.    No  significant  differences- 


Internal  Validity  Threats 


History 


Matxiration 


"lesign  controlled. 

Agents  were  ajsked  to  conduct  leader  training  program  as 

they  ordinarily  would. 
Extent  to  which  agents  interacted  .d.th  experimented  group 

was  checked.    Very  little  interaction. 

Design  controlled.    Only  four  months  from  mailing  of  first 
lesson  to  return  of  final  questionnaire. 


Testing 

Instrumentation 


Design  controlled.    No  pretest. 
Design  controlled. 

Rate  of  retiim  by  experimental  and  control  groups 

compared.    No  significant  difference. 
(Development  of  Instruments  described  belovr. ) 


Regression 


Design  controlled. 


Selection 


Design  controlled. 

See  above  under  "Distrust"  of  Randomization,  Internal. 


THREATS 


CONTROL  TECHNIQUES 


Mortality 


Interaction  of 
Selection  and 
Maturation,  etc. 


Design  controlled. 

A  telephone  interview  survey  of  a  sub-sample  of  50  sul)jec"^'S 
compared  exi)erimental  and  control  groups  on  their 
intentions  to  continue  or  not  continue  as  a  U-H  leader. 
No  significant  difference. 

Design  controlled. 


Externeil  Validity  Threats 


Interaction  of 
Testing  and 
Treatment 


Interaction  of 
Selection  and 
Treatment 


Reactive 
Arreuigements 
(Hawthorne 
Effect) 


Design  controlled.    A  pre-test  would  have  heen  an 
"unusual"  event  for  adult  lay  leaders  which  likely 
would  have  sensitized  all  subjects  to  l^-H  leader 
training  activities,  whether  the  correspondence 
course  or  other  training. 

None  of  the  randomly  selected  counties  refused  to 
cooperate . 

All  leaders  volunteered  to  serve  with  the  expectation 
that  they  would  he  offered  training  opportunities. 

Check  on  representativeness  of  sample.    See  above  under 
"Distrust"  of  Randomization. 

Demographic  data  obtained  on  sub-sample  of  non-respondents. 
No  significant  differences  between  them  and  respondents- 

Agents  were  asked,  not  to  change  their  regular  leader 
training  program,  and  to  avoid  making  leaders  aware 
that  research  was  \inderway  or  that  some  leaders  were 
getting  something  that  others  weren^t. 

Correspondence  course  lessons  were  sent  from  the  county 
Extension  office  under  cover  of  a  letter  from  the 
county  agent .    Quiz  sheets  were  returned  to  county 
agent. 

Married . couples  who  were  both  new  leaders,  and  new 
leaders  in  the  same  club,  were  assigned  as 
"sanqpling  units."    A  sampling  xinit  was  assigned 
either  to  the  experimental  or  to  the  control  group 
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THREATS  CONTROL  TECaiNIQUES 

Demographic  data  vere  obtained  in  the  last  section  of 

the  ques^tionnaire. 
Agents  were  interviewed  after  questionnaires  were 

sent  to  leaders.    They  felt  that  leaders  were 

unaware  that  they  were  involved  in  reseeurch. 
Subjects  in  the  telephoned  sub-sample  were  asked 

if  they  knew  they  were  involved  in  research. 

None  of  kk  respondents  knew. 

Multiple  Leaders  were  not  subjected  to  multiple  treatments. 

Treatment 

Interference 


OTHER  TECHNIQUES 


Development  of  Knowledge  Test 

1.  Fifty  (ten  on  each  of  the  five  lessons)  multiple  choice  questions  were 
prepared  by  researcher. 

2.  Content  validity  was  checked  by  the.  writer  of  the  lessons  and  the 
state  U-H  staff. 

3.  Test  sent  to  120  lesuiers  in  non-sainple  counties. 

k.    Item  analysis  nin  on  residts  returned  by  k9  leaders^ 

5-    Twenty  "best"  questions  (four  from  each  lesson)  were  chosen  for  the 
final  instrument. 


Development  of  Forced-Choice  Practices  Instrument 

1.    Researcher  prepared  a  list  of  32  "desirable  U-H  club  practices". 

2     State  U-H  staff  and  area  U-H  agents  Judged  the  extent  to  which  each 
practice  was  carried  out  in,  first,  an  "ideal"  U-H  club,  and  second, 
in  an  "ineffective"  U-H  club. 

3*    From  responses  an  Applicability  Index  and  a  Discrimination  Index  were 
calculated. 


h.    Ten  pairs  of  practices  were  prepared;  for  each  pair  the  Applicability 
Indexes  were  similar,  but  the  Discrimination  Indexes  were  dissimilar • 

5.    A  point  was  scored  each  time  a  respondent  chose  the  item  in  each  pair 
which  was  associated  more  highly  with  an  ideal  k^H  club. 


Pretest  of  Questionncdre 

The  questionnaire  was  pretested  in  a  personal  visit  with  a  small  number  of 
non-sample  new  leaders* 


Follow-up  Telephone  Interviews 

1.  Ten  subj icts  from  each  of  the  ten  counties  were  randomly  selected. 
Telephone  nvanbers  were  obtained  for  them.    Calls  were  made  until  five 
completed  interviews  were  obtained  from  each  county. 

2.  Purposes  of  telephone  interviews 

a.  Obtain  demographic  data  on  some  non  respondents. 

b.  Obtedn  information  on  evaluation  of  the  correspondence  caurse. 

c.  Determine  whether  respondents  felt  they  were  "taking  a  test" 
while  completing  questionnaire. 

~d7''  Determine  whether  (and  where)  respondents  sought  help  in 

answering  questions  in  knowledge  portion  of  the  questionnaire, 

e.    Determine  whether  leaders  utilized  printed  U-H  resource 
materials • 

3.  Evening  station-to-station  calls  were  dialed  directly.    Seventy  charged 
cauLls  were  necessary  to  complete  fifty  interviews .    No  one  refused  to  be 
interviewed. 


erJc 


Follow-up  Agent  Interviews 

1.  One  person  from  each  county  Extension  office  was  interviewed.  Criterion 
on  who  interviewed  being  that  he  (she)  had  been  intimately  involved  in 
administering  correspondence  course.    Interviews  were  in  person  or  by 
telephone. 

2 .  Purposes 

a.  Determine  whether  Hawthorne  Effect  had  been  controlled. 

b.  Assess  extent  of  interaction  between  "students"  and  "instructor" 
during  correspondence  course* 

c.  Evaluative  information  regarding  their  use  of  the  correspondence 
course . 


Order  of  Statlsticed  AneLLysis 

1»    Descriptive  statistics  siMmnarized  first. 
2»    Aflsociational  hypotheses  tested  next. 

a.  Dependent  variables  were  (1)  knowledge  test  scores  and 
(2)  desirable  practices  scores. 

b.  Independent  variables  were,  for  the  most  part,  demographic 
data  on  leaders. 

Significant  relationships  were  to  be  analyzed  ftirther  as  experimental 
hypotheses  were  discussed.    Non-significant  relationships  were  to  be  ruled  out 
affecting  experimental  findings. 

3.    Experimental  hypotheses  analyzed  thirdly. 

k.    Finally,  other  "unanticipated  and  interesting"  findings  were  explored. 
For  example,  did  correspondence  course  participants  who  returned  all 
five  quiz  sheets  score  higiher  on  the  knowledge  test  than  those  who 
returned  fewer  or  none?    (Yes,  but  not  significantly.) 


THE  EFFECTIVENESS  OF  A  CORRESPONDENCE  COURSE  FOR  NEW  4-H  LEADERS 

BY 

Richard  E.  Young 


One  of  the  major  concerns  of 
Cooperative  Extension  Service  faculty  who 
work  with  the  4-H  program  is  to  arrange 
appropriate  educational  experiences  for 
new  4-H  leaders.    When  a  series  of  five 
correspondence  course  lessons  for  new  4-H 
leaders  was  developed,  printed,  and  dis- 
tributed in  Ohio  in  1970,  an  opportunity 
was  available  to  test  its  effectiveness. 

This  study  had  three  major  objectives. 
First,  to  evaluate  whether  the  correspon- 
dence course  was  effective  in  helping  new 
leaders  gain  knowledge  about  4-H  and/or 
in  encouraging  the  performance  of  desirable 
practices  in  the  new  leaders'  4-H  clubs. 
Second,  to  explore  the  relationships  which 
may  have  existed  between  4-H  leaders'  know- 
ledge of  4-H  and  the  practices  in  their 
4-H  clubs,  and  a  number  of  characteristics 
of  the  new  leaders.    And,  third,  to  des- 
cribe the  new  4-H  leaders  in  Ohio. 

A  random  sample  of  ten  of  Ohio's 
eighty-eight  counties  was  selected  for  par- 
ticipation in  the  study.    All  new  leaders 
recruited  in  these  counties  between 
July  1,  1969  and  May  1,  1970  were  included 
in  the  sample.    Each  of  these  360  new 
leaders  was  randomly  assigned  to  either  an 
experimental  group  which  received  the 
correspondence  course  lessons  or  to  a 
control  group  which  did  not. 

Data  were  obtained  through  a  mailed 
questionnaire  from  219  of  the  new  leaders. 
The  first  section  of  the  questionnaire  was 

ultiple  choice  twenty-item  knowledge 
L*    L  relating  to  the  correspondence  course 
lessons.    The  second  section  was  designed 
to  measure  the  extent  to  which  desirable 
practices  were  carried  out  in  the  4-H 
leaders'  clubs.  The  third  questionnaire 
section  asked  for  demographic  data  about 
the  leaders. 


A  sub-sample  of  fifty  of  the  new 
leaders  was  telephoned  in  an  effort  to 
further  evaluate  the  correspondence  course 
and  to  get  information  from  leaders  who  did 
not  return  questionnaires. 

Evidence  from  the  study's  findings 
showed  the  correspondence  course  to  be 
effective  in  helping  leaders  to  know  about 
4-H;  participants  in  the  courpr  scored 
higher  than  non-participants.    On  the  other 
hand,  there  was  uo  difference  between  the 
experimental  and  control  groups  in  the  extent 
to  which  desirable  club  practices  were  per- 
formed. 

New  4-H  leaders  can  be  expected  to  read 
correspondence  course  lessons  and  to  evaluate 
them  favorably.    With  no  instructions  other- 
wise. Extension  faculty  initiated  only  mini- 
mal interaction  between  themselves  and 
correspondence  course  participants.  Both 
lay  leaders  and  Extension  faculty  appreciated 
the  convenience  and  flexibility  of  the  cor- 
respondence course  jnethod  of  teaching. 

Female  new  4-H  leaders  scored  higher  on 
the  knowledge  test  than  did  males.    No  sig- 
nificant difference  between  sexes  was  found 
regarding  4-H  club  practices. 

None  of  the  leader  characteristics  was 
found  to  be  related  significantly  either  to 
knowledge  or  pratice  scores.     The  leader 
characteristics  included  educational  attain- 
ment, amount  of  contact  with  Extension, 
former  4-11  membership,  family  income,  age, 
number  of  other  youth  groups  worked  with, 
and  place  of  residence. 

The  new  4-H  club  leaders  were 
resourceful  in  seeking  help  as  they  completed 
the  knowledge  test.    Printed  4-H  publications 
were  their  most  fruitful  resources. 


